AIBearisharXiv – CS AI · Jun 257/10
🧠
Perfect Detection, Failed Control: The Geometry of Knowing vs. Steering in Language Models
Researchers discovered that language models can detect undesirable behaviors like hallucination with near-perfect accuracy, yet the neural directions enabling detection are nearly orthogonal (83 degrees apart) from those controlling the behavior. This fundamental geometric dissociation between knowing and steering persists across multiple models and scales, challenging a core assumption of mechanistic interpretability that detection should enable control.