AINeutralarXiv – CS AI · 11h ago6/10
🧠
Disentangling Intrinsic Importance from Emergent Structure in Multi-Expert Orchestration
Researchers introduce INFORM, an interpretability framework for analyzing multi-expert LLM orchestration systems, revealing that frequently routed experts often serve as structural hubs with minimal functional impact while sparsely selected experts can be critically important. The study challenges conventional assumptions about expert importance in collaborative AI systems and provides tools for understanding opaque decision-making in complex model architectures.