#autoformalization News & Analysis

3 articles tagged with #autoformalization. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AINeutralarXiv – CS AI · Jun 96/10

🧠

(Auto)formalization is supposed to be easy: Trellis process semantics for spelling out rigorous proofs

Researchers present Trellis, an autoformalization system that uses LLM agents within constrained workflows to convert natural language mathematical proofs into Lean formal code. The system achieves reliable formalization on modest computational budgets by enforcing incremental progress through iterative refinement, demonstrated by formalizing a recent Ramsey theory breakthrough.

AINeutralarXiv – CS AI · May 286/10

🧠

Risk-Controlled Lean-as-Judge for Natural-Language Mathematical Reasoning

Researchers demonstrate that Lean formal proof verification produces unreliable signals for validating natural-language mathematical reasoning, with accuracy varying from 96% at high coverage to 20% at low coverage. They introduce COVCAL, a risk-control method that certifies when partial formal signals can be trusted, showing that feasibility depends critically on autoformalization quality and coverage rates.

AINeutralarXiv – CS AI · May 126/10

🧠

CodeClinic: Evaluating Automation of Coding Skills for Clinical Reasoning Agents

CodeClinic introduces a benchmark for evaluating whether large language model agents can autonomously generate clinical skills rather than relying on pre-built tool libraries. The research demonstrates that an offline autoformalization pipeline converting clinical guidelines into Python libraries improves consistency and reduces token usage by 40% compared to zero-shot code generation.