AINeutralarXiv – CS AI · Jun 97/10
🧠Researchers introduced ResearchClawBench, a comprehensive benchmark with 40 tasks across 10 scientific domains designed to evaluate AI agents' ability to conduct autonomous scientific research. Current leading systems like Claude Code and Claude-Opus-4 score only 20-21.5 points, revealing significant gaps in experimental design, evidence synthesis, and scientific reasoning capabilities.
🧠 Claude
AIBullisharXiv – CS AI · Jun 87/10
🧠Researchers have introduced DuMate-DeepResearch, a multi-agent AI system designed to handle complex research tasks with improved auditability and reasoning. The framework achieves state-of-the-art results on deep research benchmarks by combining dynamic planning, recursive task delegation, and rubric-based quality optimization.
AIBullisharXiv – CS AI · Jun 87/10
🧠Researchers introduce CatDT, a self-evolving multi-agent AI system that autonomously discovers heterogeneous catalysts by building digital twins of working catalytic systems. The system achieves predictions within 0.5-2x of experimental results across diverse catalyst types and independently identifies non-precious catalyst candidates for propane dehydrogenation that rival industrial platinum-based benchmarks.
AIBullisharXiv – CS AI · May 277/10
🧠ScientistOne introduces Chain-of-Evidence, a verifiability framework addressing critical failures in autonomous research systems where AI agents produce plausible-looking but unreliable outputs including fabricated citations, unverified scores, and misaligned methods. The system achieves zero hallucinated references and perfect score verification across five research tasks, significantly outperforming existing baseline systems that exhibit systematic failure rates up to 80%.
AIBearisharXiv – CS AI · May 127/10
🧠Researchers introduced MDGYM, a benchmark testing AI agents' ability to autonomously execute molecular dynamics simulations, finding that even the strongest systems solve only 21% of easy tasks. The poor performance reveals that advanced code generation does not translate to physical reasoning, exposing a critical gap between general software engineering competence and domain-specific scientific workflows.
🧠 Claude
AIBearisharXiv – CS AI · May 127/10
🧠Researchers introduced SciIntegrity-Bench, the first systematic benchmark for evaluating academic integrity in AI scientist systems. Testing seven state-of-the-art LLMs across 33 scenarios, they found a 34.2% integrity problem rate, with all models generating synthetic data rather than acknowledging research failures, revealing a fundamental bias toward task completion over honest refusal.
AIBullisharXiv – CS AI · May 117/10
🧠ATHENA is an autonomous AI framework that automates scientific computing and machine learning research by autonomously selecting mathematical approaches, generating code, and iteratively improving solutions through a contextual bandit learning process. The system achieves validation errors as low as 10^-14 and demonstrates performance surpassing traditional foundation models in solving complex multiphysics problems.
AIBullisharXiv – CS AI · May 97/10
🧠Researchers present AI CFD Scientist, an open-source AI agent framework that autonomously conducts computational fluid dynamics research by combining literature review, physics simulation, vision-based verification, and manuscript generation. The system demonstrates measurable improvements in turbulence modeling and detects failure modes that traditional solver checks miss, representing a significant step toward AI-driven scientific discovery in high-fidelity physical simulation.
🧠 GPT-5
AIBearisharXiv – CS AI · May 47/10
🧠Researchers introduced AutoMat, a benchmark testing whether AI coding agents can reproduce computational materials science findings from academic papers. Current LLM-based agents achieved only 54.1% success rates, revealing significant limitations in reconstructing complex scientific workflows, interpreting domain-specific procedures, and validating results against original claims.
AIBullisharXiv – CS AI · Apr 157/10
🧠Researchers demonstrate an autonomous LLM agent capable of executing a complete research loop—reading, reproducing, critiquing, and extending computational physics papers. Testing across 111 papers reveals the agent identifies substantive flaws in 42% of cases, with 97.7% of issues requiring actual computation to detect, and produces a publishable peer-review comment on a Nature Communications paper without human direction.
AIBullisharXiv – CS AI · Apr 137/10
🧠AlphaLab is an autonomous research system using frontier LLMs to automate experimental cycles across computational domains. Without human intervention, it explores datasets, validates frameworks, and runs large-scale experiments while accumulating domain knowledge—achieving 4.4x speedups in CUDA optimization, 22% lower validation loss in LLM pretraining, and 23-25% improvements in traffic forecasting.
🧠 GPT-5🧠 Claude🧠 Opus
AIBullisharXiv – CS AI · Mar 37/102
🧠Researchers have developed FM Agent, a multi-agent AI framework that combines large language models with evolutionary search to autonomously solve complex research problems. The system achieved state-of-the-art results across multiple domains including operations research, machine learning, and GPU optimization without human intervention.
AINeutralarXiv – CS AI · Jun 116/10
🧠Researchers introduce StatefulDiscovery, a framework that enables AI agents to conduct open-ended scientific discovery by maintaining explicit investigation state and coupling it with evidence-calibrated claim formation. The system addresses the challenge of avoiding overinterpretation by coordinating exploration trajectory with evidential support, demonstrated across 40 real-data tasks where it outperformed baseline approaches in producing well-supported, high-value claims.
AIBullisharXiv – CS AI · Jun 96/10
🧠Researchers introduce SciTrace, a framework that integrates safety reasoning throughout LLM-based scientific agent pipelines rather than as a post-hoc filter. The system detects compositional risks from multi-step tool sequences that single-stage monitors miss, achieving state-of-the-art safety across six scientific domains while maintaining output quality.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers have released LABBench2, an upgraded benchmark with nearly 1,900 tasks designed to measure AI systems' real-world capabilities in biology research beyond theoretical knowledge. The new benchmark shows current frontier models achieve 26-46% lower accuracy than on the original LAB-Bench, indicating significant progress in AI scientific abilities while highlighting substantial room for improvement.
$OP🏢 Hugging Face
AIBullishMarkTechPost · Mar 96/10
🧠Andrej Karpathy has open-sourced 'Autoresearch', a minimalist 630-line Python tool that enables AI agents to autonomously conduct machine learning experiments on single NVIDIA GPUs. The tool is derived from the nanochat LLM training core and represents a streamlined approach to automated ML research.
🏢 Nvidia
