Evidence for Limited Metacognition in LLMs

Researchers developed new methods to quantitatively measure metacognitive abilities in large language models, finding that frontier LLMs since early 2024 show increasing evidence of self-awareness capabilities. The study reveals these abilities are limited in resolution and qualitatively different from human metacognition, with variations across models suggesting post-training influences development.