#sampling-algorithms News & Analysis

2 articles tagged with #sampling-algorithms. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · 15h ago7/10

🧠

On the Error-Correcting Effects of Stochasticity in Discrete Diffusion

Researchers demonstrate that stochasticity in discrete diffusion models provides an error-correcting mechanism that improves the speed-quality tradeoff in generative AI. They propose Discrete Churn and Restart Sampling (DCRS), which achieves up to 10x faster sampling on images while maintaining quality by strategically injecting controlled randomness into the inference process.

AIBullisharXiv – CS AI · 15h ago7/10

🧠

Qrita: High-performance Top-k and Top-p using Pivot-based Truncation and Selection

Researchers introduce Qrita, an efficient algorithm for Top-k and Top-p sampling in large language models that uses pivot-based truncation instead of sorting. The method achieves 1.4x throughput improvements with 50% less memory usage while maintaining identical output to traditional sorting approaches, and has been adopted as the default sampler in vLLM.