Scientists Debunk Glimmers of AGI as Illusionary.

Scientists from Stanford University argue that the glimmers of artificial general intelligence (AGI) we're seeing are all just an illusion. They claim that any seemingly emergent abilities of large language models (LLMs) may just be "mirages" borne out of inherently flawed metrics. The researchers argue that "existing claims of emergent abilities are creations of the researcher's analyses, not fundamental changes in model behavior on specific tasks with scale." They used a baseball analogy to illustrate how questionable some of the metrics that have been used to declare the emergence of AGI are.