Whilst tuning a GNN (admittedly with considerable AI help) until it finally grokked, I spent a few hours thinking about the graph that shows the exponential rise in human intelligence after 4 billion years of evolution…pretty much the same shape! I’m not sure this is a coincidence. If you treat the biosphere as a single optimisation process, the last 4 billion years looks like a classic memorisation phase. The idea … 3.8 billion years of “Memorisation”: Evolution produced specialised narrow solutions (bat sonar, shrimp vision). These are brilliant, but they don’t transfer. They’re basically hard-coded solutions for specific distributions. The “Grok” Transition: Human collective intelligence was our first true generalisation event. Our hardware (brains) didn’t change much, but language and culture allowed us to represent the underlying structure of the world rather than just memorising how to survive in a forest. What’s next? Is current AI the pre-processing stage of the next big leap. In ML, grokking often happens when weight decay makes memorisation too expensive. What was the biological equivalent that forced us toward general intelligence? I wrote a deeper dive on this analogy and the timeline of these phase transitions here: https://www.4billionyearson.org/posts/the-grokking-of-life-on-earth-evolution-intelligence-and-the-next-phase-of-ai Curious as to what people think … AI looks like being a bigger explosion in intelligence than humans were, but will it lead to a new form of life on earth? submitted by /u/4billionyearson
Originally posted by u/4billionyearson on r/ArtificialInteligence
You must log in or # to comment.