#neural-geometry News & Analysis

2 articles tagged with #neural-geometry. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBearisharXiv – CS AI · Jun 257/10

🧠

Perfect Detection, Failed Control: The Geometry of Knowing vs. Steering in Language Models

Researchers discovered that language models can detect undesirable behaviors like hallucination with near-perfect accuracy, yet the neural directions enabling detection are nearly orthogonal (83 degrees apart) from those controlling the behavior. This fundamental geometric dissociation between knowing and steering persists across multiple models and scales, challenging a core assumption of mechanistic interpretability that detection should enable control.

AINeutralarXiv – CS AI · May 116/10

🧠

The E$\Delta$-MHC-Geo Transformer: Adaptive Geodesic Operations with Guaranteed Orthogonality

Researchers present the E∆-MHC-Geo Transformer, a novel deep learning architecture that maintains orthogonality in residual connections across all input values and parameters, outperforming existing methods like JPmHC and GPT on stability and rotation metrics while using 33% fewer layers.