AINeutralarXiv – CS AI · 3h ago6/10
🧠
Architecture-driven Shift: towards a lightweight selector for capturing the trends of logit shift
Researchers propose Architecture-driven Shift (ADS), a lightweight computational method to predict how pre-trained neural networks will perform in continual learning scenarios by measuring logit shift without expensive calculations. The approach theoretically decouples architecture characteristics from data dependency, achieving strong correlation with actual performance across 175+ diverse model architectures.