AIBullisharXiv – CS AI · 14h ago7/10
🧠
DenseSteer: Steering Small Language Models towards Dense Math Reasoning
Researchers propose DenseSteer, a training-free framework that improves mathematical reasoning in small language models (≤3B parameters) by steering internal representations toward denser reasoning patterns. The method demonstrates that smaller models can match larger ones' performance by executing fewer, more information-rich reasoning steps rather than verbose chain-of-thought processes.