AINeutralarXiv – CS AI · 3h ago6/10
🧠
Energy-Structured Low-Rank Adaptation for Continual Learning
Researchers propose E²-LoRA, a novel continual learning method that addresses task interference by concentrating knowledge into low-rank representations rather than spreading it across multiple basis vectors. The approach theoretically proves that preserving parameters along principal drift directions minimizes reconstruction error while freeing model capacity for future tasks.