#representational-geometry News & Analysis

4 articles tagged with #representational-geometry. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles

AINeutralarXiv – CS AI · Jun 236/10

🧠

Abstract representational geometry supports inference in large language models

Researchers demonstrate that large language models develop abstract geometric structures in their internal representations when performing inference tasks, mirroring hippocampal organization in human brains. These geometric patterns emerge hierarchically across model layers and mechanistically support generalized reasoning, suggesting LLMs employ similar organizational principles to humans for adaptive task inference.

AINeutralarXiv – CS AI · Jun 86/10

🧠

The Geometry of Representational Failures in Vision Language Models

Researchers have identified mechanistic explanations for why Vision-Language Models fail at multi-object visual tasks by analyzing the geometric structure of internal representations. By extracting and steering "concept vectors" in open-weight VLMs, they discovered that geometric overlap between these vectors correlates directly with specific error patterns, providing a quantitative framework for understanding representational failures.

AINeutralarXiv – CS AI · Jun 36/10

🧠

Decomposing how prompting steers behavior

Researchers introduce a geometric decomposition framework to understand how prompting reshapes internal representations in large language models and vision-language models without weight updates. Testing across multiple models and datasets reveals that prompts consistently reorganize representations toward task structures, with cross-dimensional linear mixing (affine transformations) emerging as a key mechanism for prompt-driven behavior.

AINeutralarXiv – CS AI · Mar 37/108

🧠

Diagnosing Generalization Failures from Representational Geometry Markers

Researchers propose a new approach to predict AI model failures by analyzing geometric properties of data representations rather than reverse-engineering internal mechanisms. They found that reduced manifold dimensionality and utility in training data consistently predict poor performance on out-of-distribution tasks across different architectures and datasets.