#lora-adaptation News & Analysis

2 articles tagged with #lora-adaptation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · May 116/10

🧠

Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA

Researchers propose GLoRA, a gauge-aware federated learning framework that improves parameter-efficient adaptation of large language models by aggregating semantic updates rather than raw LoRA factors. The method addresses a fundamental mathematical limitation in existing federated LoRA systems and demonstrates consistent performance improvements across heterogeneous client scenarios.

AINeutralarXiv – CS AI · Apr 136/10

🧠

On-the-Fly Adaptation to Quantization: Configuration-Aware LoRA for Efficient Fine-Tuning of Quantized LLMs

Researchers introduce CoA-LoRA, a method that dynamically adapts LoRA fine-tuning to different quantization configurations without requiring separate retraining for each setting. The approach uses a configuration-aware model and Pareto-based search to optimize low-rank adjustments across heterogeneous edge devices, achieving comparable performance to traditional methods with zero additional computational cost.