AIBullisharXiv – CS AI · Jun 197/10
🧠Researchers demonstrate that the Lean proof assistant can provide fine-grained, process-level feedback during reinforcement learning training for theorem proving, beyond simple binary verification signals. By parsing proof attempts into tactic sequences and leveraging Lean's elaboration system, the approach delivers dense, verified credit signals grounded in type theory, showing improvements over outcome-only baselines on benchmarks like MiniF2F and ProofNet.
AIBullisharXiv – CS AI · Jun 17/10
🧠Researchers introduce Hermes, an AI agent that combines informal reasoning with formally verified mathematical proofs in Lean, achieving up to 40% accuracy improvements on difficult math benchmarks while reducing computational costs by 80%. The system addresses a fundamental limitation in LLM reasoning by interleaving exploratory problem-solving with rigorous formal verification.
AIBullisharXiv – CS AI · Mar 57/10
🧠Researchers have developed LeanTutor, a proof-of-concept AI system that combines Large Language Models with theorem provers to create a mathematically verified proof tutor. The system features three modules for autoformalization, proof-checking, and natural language feedback, evaluated using PeanoBench, a new dataset of 371 Peano Arithmetic proofs.
AINeutralarXiv – CS AI · Mar 47/104
🧠Researchers have introduced SorryDB, a dynamic benchmark for evaluating AI systems' ability to prove mathematical theorems using the Lean proof assistant. The benchmark draws from 78 real-world formalization projects and addresses limitations of static benchmarks by providing continuously updated tasks that better reflect community needs.
AINeutralarXiv – CS AI · Feb 277/107
🧠Researchers introduced LeanCat, a benchmark comprising 100 category-theory tasks in Lean to test AI's formal theorem proving capabilities. State-of-the-art models achieved only 12% success rates, revealing significant limitations in abstract mathematical reasoning, while a new retrieval-augmented approach doubled performance to 24%.
AIBullishOpenAI News · Feb 27/105
🧠Researchers have developed a neural theorem prover for Lean that successfully solved challenging high-school mathematics olympiad problems, including those from AMC12, AIME competitions, and two problems adapted from the International Mathematical Olympiad (IMO). This represents a significant advancement in AI's ability to handle formal mathematical reasoning and proof generation.
AIBullisharXiv – CS AI · Jun 126/10
🧠Pythagoras-Prover introduces a family of efficient Lean theorem provers that achieve state-of-the-art performance with significantly fewer parameters than existing models, using novel training techniques including curriculum learning and augmented data generation. The 4B-parameter model outperforms DeepSeek-Prover-V2-671B by 167x parameter efficiency, while the 32B model sets new benchmarks on formal mathematics tasks.
AINeutralarXiv – CS AI · Jun 46/10
🧠Researchers introduced AlgoVeri, a unified benchmark for evaluating AI-generated formally verified code across three major verification systems (Dafny, Verus, and Lean). The benchmark reveals significant performance disparities depending on the verification language, with frontier AI models achieving 40.3% success in Dafny but only 7.8% in Lean, highlighting fundamental challenges in cross-paradigm code verification.
🧠 Gemini
AIBullishIEEE Spectrum – AI · Mar 27/107
🧠Ukrainian mathematician Maryna Viazovska's Fields Medal-winning sphere packing proofs have been formally verified through AI-human collaboration using Math, Inc.'s Gauss AI system and the Lean proof assistant. This represents a significant breakthrough in AI's ability to assist with complex mathematical research and formal proof verification.
$TAO
