AIBullisharXiv – CS AI · 6h ago7/10
🧠
Sample Where You Struggle: Sharpening Base Model Reasoning via Entropy-Guided Power Sampling
Researchers introduce Entropy-Guided Power Sampling (EGPS), a novel training-free sampling method that accelerates reasoning in base language models by targeting high-entropy decision points rather than uniformly sampling across sequences. The technique achieves up to 12.6x speedup on mathematical and coding benchmarks while maintaining or improving accuracy, addressing fundamental inefficiencies in existing MCMC sampling approaches.