y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#qwen-models News & Analysis

4 articles tagged with #qwen-models. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles
AIBullisharXiv – CS AI · Jun 97/10
🧠

Sparrow: Sparse Rollout for Stable and Efficient Long-context RL of Large Language Models

Researchers introduce Sparrow, a dynamic sparsity scheduling method that accelerates reinforcement learning training for large language models by 2-2.4x while maintaining stability. The approach identifies a critical threshold in per-token actor-policy mismatch that prevents training collapse during sparse rollout generation, with further improvements possible through distillation techniques.

AIBullisharXiv – CS AI · Jun 57/10
🧠

Closing the Loop on Latent Reasoning via Test-Time Reconstruction

Researchers introduce ReLAT, a test-time training method that improves latent reasoning in large language models by reconstructing the original query from intermediate latent states, ensuring task-relevant information is preserved. The approach demonstrates significant performance gains across mathematical reasoning, QA, and code generation tasks, with Qwen3-8B achieving a 16.6-point improvement on AIME 2024.

AIBullisharXiv – CS AI · Jun 196/10
🧠

Beyond Entropy: Learning from Token-Level Distributional Deviations for LLM Reasoning

Researchers introduce the Independent Combinatorial Tokens (ICT) framework to improve Large Language Model reasoning by addressing entropy collapse and explosion problems in reinforcement learning. Using Jensen-Shannon divergence to identify critical token branching points, ICT achieves 4.58% average improvement in pass@4 scores across math, commonsense, and Olympiad benchmarks on Qwen models.