2 articles tagged with #best-of-n-sampling. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers propose Symbolic Equivalence Partitioning, a novel inference-time selection method for code generation that uses symbolic execution and SMT constraints to identify correct solutions without expensive external verifiers. The approach improves accuracy on HumanEval+ by 10.3% and on LiveCodeBench by 17.1% at N=10 without requiring additional LLM inference.
Researchers analyze how Best-of-N sampling constructs preference data for reward learning in AI systems, deriving closed-form targets and identifying a fundamental tradeoff between margin and connectivity governed by N size. The work provides design principles for practitioners: use larger N when preference labels are scarce, smaller N when generation capacity is limited, and optimize base distributions to prioritize comparisons most relevant at deployment.
