AIBullisharXiv – CS AI · 18h ago7/10
🧠
STAR: Rethinking MoE Routing as Structure-Aware Subspace Learning
Researchers introduce STAR, a novel Mixture-of-Experts routing mechanism that leverages subspace learning to improve how AI models distribute computational tasks across specialized expert networks. By incorporating structure-aware routing via the Generalized Hebbian Algorithm, STAR demonstrates more stable and efficient expert specialization compared to traditional shallow linear routing approaches.