AINeutralarXiv – CS AI · 11h ago6/10
🧠
Essential Subspace Merging for Multi-Task Learning
Researchers propose Essential Subspace Merging (ESM), a training-free method that combines multiple task-specific models into a single multi-task model by identifying and orthogonalizing principal component directions while suppressing interference-causing noise. The approach demonstrates that most inter-task interference stems from accumulated energy in non-essential directions rather than core task-relevant updates, enabling efficient model consolidation across multiple domains.