3 articles tagged with #masked-language-models. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers introduce Self-Aware Scheduling (SAS), a method that learns optimal token unmasking orders in masked diffusion language models through policy optimization. The approach significantly improves generation quality on reasoning tasks, achieving 91.8% accuracy on Sudoku (up from 82%) and boosting mathematical reasoning performance by 12 percentage points on GSM8K.
Researchers propose using random walks on graphs as a testing framework for parallel sampling strategies in masked diffusion models, proving that popular entropy-based sampling methods aren't universally optimal and introducing a new bisection sampler that achieves logarithmic-time sampling with theoretical guarantees.
Researchers introduce McDiffuSE, an MCTS-based framework that optimizes slot-filling order in Masked Diffusion Models to improve performance on mathematical and code reasoning tasks. The approach achieves 3.2% improvement over autoregressive baselines and up to 19.5% gains on specific benchmarks by strategically exploring generation orderings rather than following sequential patterns.
