4 articles tagged with #embedding-geometry. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers propose a geometric framework for detecting hallucinations in large language models by analyzing embedding space structure, categorizing three types of errors with different detectability profiles. The approach outperforms standard NLI baselines on expert-annotated datasets, providing interpretable diagnostics for production systems operating under black-box constraints.
Researchers investigate why visual grounding models fail when image captions are semantically mismatched, hypothesizing that embedding anisotropy may be responsible. Testing two transformer-based models with different embedding geometries reveals no meaningful correlation between cosine similarity and approximation errors, suggesting the problem requires investigation of deeper geometric properties.
Researchers investigate how large language models solve compositional tasks, revealing that LLMs employ two distinct mechanisms—compositional and direct—rather than consistently breaking problems into intermediate steps. The study demonstrates that embedding space geometry determines which mechanism dominates, with direct solving more prevalent when tasks align with translation patterns in embedding spaces.
Research reveals that multi-agent LLM committees suffer from 'representational collapse' where agents produce highly similar outputs despite different role prompts, with mean cosine similarity of 0.888. A new diversity-aware consensus protocol (DALC) improves accuracy to 87% while reducing token costs by 26% compared to traditional self-consistency methods.
