5 articles tagged with #constrained-generation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers propose In-Writing, a hybrid decoding framework for LLMs that separates reasoning from formatting constraints. The approach allows models to perform free-form reasoning before applying structured output constraints, demonstrating accuracy improvements up to 27% over standard methods across classification and reasoning tasks.
Researchers present a constrained natural-language interface for finite element simulations that uses LLMs only for front-end parsing tasks while delegating critical solver logic to human-written templates. The system achieves 100% parse validity and demonstrates effective integration of language models with scientific computing by limiting AI to non-critical paths, reducing reliability risks.
Researchers introduce Dynamic Infilling Anchors (DIA), a training-free method that improves how diffusion large language models generate structured outputs like JSON or reasoning templates. By dynamically adjusting generation length constraints, DIA achieves better format compliance and accuracy on mathematical reasoning benchmarks without requiring model retraining.
Researchers introduce Constrained Adaptive Rejection Sampling (CARS), a novel technique that improves the efficiency of generating constrained outputs from language models while maintaining distributional fidelity. The method adaptively prunes invalid continuations using a trie data structure, achieving higher sample validity rates without sacrificing output diversity.
Researchers introduce primal-dual guided decoding, an inference-time method for discrete diffusion models that enforces global constraints during token generation through adaptive Lagrangian multipliers and KL-regularized optimization. The approach requires no model retraining, supports multiple simultaneous constraints, and demonstrates effectiveness across text generation, molecular design, and music applications.
