AINeutralarXiv – CS AI · 10h ago6/10
🧠
Probing Routing-Conditional Calibration in Attention-Residual Transformers
Researchers question whether routing traces in Attention-Residual transformers provide genuine evidence of improved post-hoc calibration beyond standard confidence metrics. Through rigorous statistical testing with matched controls, the study finds that routing-specific features offer minimal stable evidence of better calibration, suggesting previous claims of calibration improvements may reflect methodological artifacts rather than true model improvements.