AIBullisharXiv – CS AI · Jun 257/10
🧠Researchers demonstrate that reinforcement learning post-training for large language models can generate effective step-level reward signals without dedicated reward model training. The 'progress advantage' metric—derived from log-probability ratios between trained and reference policies—eliminates annotation overhead while matching or exceeding performance of purpose-built reward models across multiple applications.
AINeutralarXiv – CS AI · Jun 27/10
🧠Researchers establish a theoretical framework explaining why large language models optimized through outcome-based reinforcement learning develop brittle reasoning despite strong benchmark performance. The study introduces 'Reward-Induced Manifold Collapse' and demonstrates that process reward models can prevent this failure mode by enforcing information constraints on reasoning steps.
AINeutralarXiv – CS AI · Jun 86/10
🧠Researchers introduce StainFlow, a process reward model that improves reinforcement learning for GUI agents by tracking entity states and dynamically linking evidence across trajectories. The method achieves 3.2% relative improvement in online RL success and 1.8% improvement in trajectory completion accuracy on benchmark tasks.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers introduce PRO-CUA, a reinforcement learning framework that improves training of computer use agents (AI systems that automate digital workflows) by using step-level process rewards instead of trajectory-level feedback. The method reduces training costs and distribution shift while achieving better performance on live web benchmarks.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers introduce RoRo, a novel framework for stepwise model routing in Large Reasoning Models that uses process-based rewards rather than outcome-only rewards to evaluate intermediate routing decisions. The approach combines rubric-guided evaluation with reinforcement learning to improve efficiency and accuracy across multiple reasoning benchmarks.
AINeutralarXiv – CS AI · May 126/10
🧠Researchers introduce Verifiable Process Rewards (VPR), a framework that enhances reinforcement learning for large language models by providing dense, intermediate-level feedback during reasoning tasks rather than relying solely on sparse outcome-level rewards. The approach leverages symbolic, algorithmic, and probabilistic verification methods to improve credit assignment in long-horizon agentic reasoning, with theoretical and empirical validation across multiple benchmarks.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers introduce a novel reinforcement learning approach for diffusion-based language models that uses process-level rewards during the denoising trajectory, rather than outcome-based rewards alone. This method improves reasoning stability and interpretability while enabling practical supervision at scale, advancing the capability of non-autoregressive text generation systems.
AIBullisharXiv – CS AI · Apr 146/10
🧠Researchers introduce HiPRAG, a training methodology that improves agentic RAG systems by using fine-grained process rewards to optimize search decisions. The approach reduces inefficient search behaviors while achieving 65-67% accuracy across QA benchmarks, demonstrating that optimizing reasoning processes yields better performance than outcome-only training.
🧠 Llama
AIBullisharXiv – CS AI · Apr 66/10
🧠Researchers introduce PROGRS, a new framework that improves mathematical reasoning in large language models by using process reward models while maintaining focus on outcome correctness. The approach addresses issues with current reinforcement learning methods that can reward fluent but incorrect reasoning steps.
AIBullisharXiv – CS AI · Mar 26/1014
🧠Researchers propose SCOPE, a new framework for Reinforcement Learning from Verifiable Rewards (RLVR) that improves AI reasoning by salvaging partially correct solutions rather than discarding them entirely. The method achieves 46.6% accuracy on math reasoning tasks and 53.4% on out-of-distribution problems by using step-wise correction to maintain exploration diversity.
