AINeutralarXiv – CS AI · 11h ago5/10
🧠
Ky Fan Norms and Beyond: Dual Norms and Combinations for Matrix Optimization
Researchers introduce the Fanion family of optimization algorithms that extend beyond spectral norms used in the Muon optimizer, leveraging Ky Fan norm duals for matrix optimization in deep learning. Two variants, F-Muon and S-Muon, match or exceed Muon's performance across diverse tasks, with particular improvements on synthetic convex problems.