#reasoning-improvement News & Analysis

3 articles tagged with #reasoning-improvement. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AIBullisharXiv – CS AI · Jun 237/10

🧠

ReNIO: Reweighting Negative Trajectory Importance for LLM On-Policy Distillation

Researchers introduce ReNIO, a novel technique for improving large language model distillation by reweighting negative trajectories—incorrect reasoning paths generated by student models. The method shows that training on wrong outputs outperforms correct ones, and ReNIO leverages probability ratios to identify pivotal failure points without requiring full answer verification, delivering up to 10% improvements on mathematical reasoning benchmarks.

AIBullisharXiv – CS AI · Jun 256/10

🧠

ExTra: Exploratory Trajectory Optimization for Language Model Reinforcement Learning

Researchers introduce ExTra, a reinforcement learning framework that improves language model reasoning by extracting exploration signals from model rollouts. The method combines novelty rewards for diverse solutions with entropy-guided trajectory regeneration, achieving 5-7 point improvements over baseline GRPO across mathematical reasoning benchmarks.

AIBullisharXiv – CS AI · Mar 176/10

🧠

Nudging Hidden States: Training-Free Model Steering for Chain-of-Thought Reasoning in Large Audio-Language Models

Researchers developed training-free model steering techniques to improve reasoning in large audio-language models (LALMs) through chain-of-thought prompting. The approach achieved up to 4.4% accuracy gains and demonstrated cross-modal transfer where text-derived steering vectors can effectively guide speech-based reasoning.