Measuring Progress Toward AGI: A Cognitive Framework

Researchers propose a Cognitive Taxonomy framework to measure progress toward AGI by evaluating systems against 10 key cognitive faculties derived from psychology and neuroscience research. The framework aims to address the lack of standardized metrics for AGI advancement and provide empirical evaluation methods to support responsible AI governance.

The absence of clear AGI measurement standards has created a credibility problem in AI development. Companies and researchers make competing claims about progress without shared evaluation criteria, making it difficult for policymakers, investors, and the public to distinguish genuine advancement from marketing. This new framework attempts to bridge that gap by grounding AGI measurement in established cognitive science rather than arbitrary benchmarks.

The approach draws from decades of psychological research to identify 10 core cognitive faculties—likely including reasoning, memory, learning, perception, and other foundational abilities. By testing systems against held-out cognitive tasks, researchers can generate comparative profiles showing where an AI system excels or falls short. This parallels how human IQ testing reveals cognitive strengths and weaknesses rather than a single number.

For the AI industry and governance bodies, this framework has significant implications. Standardized cognitive profiles would enable meaningful progress tracking across different AI architectures and development timelines. Investors seeking to evaluate AI companies would gain a more objective reference point than current hype cycles. Regulators could use such frameworks to establish evidence-based safety requirements tied to actual capabilities rather than speculation.

The framework's practical value depends on adoption. If major AI labs and research institutions embrace this taxonomy, it could become the industry standard for AGI measurement. If it remains academic, its impact will be limited. The coming months will reveal whether this represents a genuine shift toward empirical rigor or another theoretical proposal amid dozens of competing frameworks.

• →Researchers introduce a Cognitive Taxonomy deconstructing AGI into 10 measurable cognitive faculties based on established psychology research.
• →The framework proposes targeted evaluation protocols that generate 'cognitive profiles' showing AI system strengths and weaknesses rather than single metrics.
• →Standardized AGI measurement could improve transparency in AI governance, investment decisions, and regulatory frameworks.
• →Current lack of shared evaluation standards has enabled subjective AGI claims that hinder responsible development and oversight.
• →Framework adoption by major AI labs will determine whether this becomes an industry standard or remains a theoretical contribution.