AIBearisharXiv – CS AI · 18h ago7/10
🧠
More Yap Less Meaning: Uncovering Self-Improvement Behavior in SLMs
A new study demonstrates that small language models (SLMs) have severely limited self-correction capabilities, gaining only 4.4% accuracy improvement even when provided correct answers and explicit hints. The research reveals that longer deliberation actually harms performance, challenging assumptions that increased compute budgets automatically improve reasoning abilities in smaller models.