AINeutralarXiv – CS AI · 10h ago6/10
🧠
Sketch-and-Verify: Structured Inference-Time Scaling via Program Sketching
Sketch-and-Verify is an inference-time scaling technique that improves small language model performance by having the LLM generate multiple algorithmic strategies as program sketches, then filling and verifying them. On HumanEval+, this approach delivers superior cost-performance within a model tier compared to flat sampling, though upgrading to a stronger model tier remains more effective than scaling test-time compute on smaller models.
🧠 Gemini