AINeutralarXiv – CS AI · 9h ago7/10
🧠
Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
Researchers have identified why layer pruning causes sudden performance collapse in large language models by analyzing decision representation dynamics. The study reveals that pruning disrupts a critical 'Silent Phase' where the model internally processes information before making predictions, while the subsequent 'Decisive Phase' remains robust to pruning.