AINeutralarXiv – CS AI · 8h ago6/10
🧠
Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA
Researchers propose GLoRA, a gauge-aware federated learning framework that improves parameter-efficient adaptation of large language models by aggregating semantic updates rather than raw LoRA factors. The method addresses a fundamental mathematical limitation in existing federated LoRA systems and demonstrates consistent performance improvements across heterogeneous client scenarios.