AINeutralarXiv – CS AI · 6h ago6/10
🧠
CRAFT: Forgetting-Aware Intervention-Based Adaptation for Continual Learning
Researchers introduce CRAFT, a continual learning framework for large language models that prevents catastrophic forgetting by learning low-rank interventions on hidden representations rather than updating model weights. The three-stage approach uses KL divergence-based routing and merging to enable models to acquire new capabilities while maintaining performance on previously learned tasks.