The details for this bar: The model must be a general model similar to today’s Claude family and GPT, and are able to fluently play most of the popular games autonomously. The model should receive the same input as human players do, meaning only pure visual inputs, and sometimes audio inputs. No additional info should be given. The model should have the same form of controls as human players do, it doesn’t have to be a physical keyboard, but they must perform the same essential functions. The model should compete or work with real professional players in real time , meaning no deliberate slow down or any other special treatments. There should be no explicitly scripted behaviors or game-specific harness. However, I remain undecided on how much the model should be allowed to train on these games specifically, as popular games also appear in training data more frequently and AI companies might also have an incentive to do so. Important clarification: The model doesn’t need to win every single time to be qualified as passing the bar (since that is no longer AGI and more like ASI), and in fact winning the competition isn’t the goal at all. Rather, it needs to demonstrate for each game it competes in: 1, That it has real-time reactions, not thinking for minutes before making the next move (I think hardware also plays a crucial role in this, but models do need to have lower latency). 2, That it has good understanding of the game mechanics such that it can fare well even when given a new map/scenario/instruction it has never seen before. 3, That it shows some competitiveness in control and strategic thinking in dynamic environments even amongst professional players. 4, That it is reliable to the extent that it almost never make very stupid moves that no professional players would make (in short: very low hallucinations). The interpretation for the standards above might be different for everyone, but I am sure most seasoned players will know it when the model reaches above a certain level. Take Minecraft, probably the only game I am familiar with: Even though the game has an objective which is beating the ender dragon, there are other in-game games created by players themselves such as spleef, PvP, hunger games, bedwars, parkour, and many more. Most of these games are relatively easy to understand and participate in even if it’s your first time playing it, and as a result, they are very popular. However, current AI struggles heavily with games like these, even with assistance, their controls are rote and slow, and show almost no ability in understanding what’s going on, let alone planning. Those esports games where millions of people watch are only going to be harder for them. I strongly believe that the ability to play like a professional player across various games can have strong implications to real-life abilities, such as driving, cleaning, and performing blue-collar works. Regardless of how this bar is reached, achieving this feat will always be a hallmark of achieving AGI to me. submitted by /u/Turbulent-Step-3207
Originally posted by u/Turbulent-Step-3207 on r/ArtificialInteligence