AINeutralarXiv – CS AI · Jun 257/10
🧠Researchers introduce Xcientist, a research harness that makes AI scientific reasoning transparent and auditable by externalizing research synthesis into inspectable artifacts. The system addresses 'claim drift'—where AI-generated mechanisms lose evidential grounding—and demonstrates traceable workflows across three scientific domains, suggesting AI scientists should be evaluated on accountability and reproducibility, not just output.
AIBullisharXiv – CS AI · Jun 117/10
🧠Researchers introduced Arbor, an AI framework enabling autonomous scientific research through long-term hypothesis refinement and iterative experimentation. The system demonstrated 2.5x better performance than existing AI models across six research tasks, suggesting meaningful advances in autonomous AI capabilities for optimization and discovery.
🧠 GPT-5🧠 Claude
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers demonstrated that AI-driven formal proof systems can autonomously solve open mathematics problems, resolving 9 Erdős problems and 44 OEIS conjectures at modest computational cost. This breakthrough validates LLMs as practical research tools when combined with formal verification systems like Lean, marking the first large-scale evaluation of this approach on genuinely open problems.
AIBullishDecrypt – AI · Jun 47/10
🧠Anthropic reports that AI systems now autonomously write most of their code and handle increasingly complex research tasks, with human involvement shifting toward problem selection rather than execution. This development suggests AI capabilities are accelerating beyond human-paced workflows, potentially reshaping how AI research and development scales.
🏢 Anthropic
AIBullisharXiv – CS AI · Jun 47/10
🧠Researchers introduce Curation-Bench, a benchmark demonstrating that AI agents can automate data curation—a critical bottleneck in AI development—by iteratively proposing and refining data-selection policies. While agents reach strong baselines quickly, they struggle to explore novel approaches without structured scaffolding that guides them toward methodological adaptation rather than local optimization.
AINeutralarXiv – CS AI · Jun 47/10
🧠Researchers introduce AutoLab, a benchmark testing whether frontier AI models can solve complex, multi-step engineering tasks over extended time horizons. Testing 17 state-of-the-art models reveals that persistence and iterative refinement—not initial quality—predict success, with most models failing to sustain long-horizon optimization despite their capabilities.
AIBullisharXiv – CS AI · May 287/10
🧠AIBuildAI-2 introduces a knowledge-enhanced AI agent that automatically builds machine learning models by combining large language models with an external, evolving knowledge system. The system achieves state-of-the-art performance, ranking first on MLE-Bench and placing in the top 6.6% of human teams in a predictive competition, democratizing AI model development for non-specialists.
AIBullisharXiv – CS AI · May 127/10
🧠NanoResearch introduces a multi-agent LLM framework that personalizes research automation through three co-evolving components: a skill bank for reusable procedural knowledge, a memory module for user-specific experience, and label-free policy learning for preference internalization. The system addresses the gap between uniform AI outputs and diverse researcher needs, demonstrating substantial improvements over existing AI research systems while reducing costs across successive cycles.
AIBullisharXiv – CS AI · Apr 157/10
🧠Researchers demonstrate an autonomous LLM agent capable of executing a complete research loop—reading, reproducing, critiquing, and extending computational physics papers. Testing across 111 papers reveals the agent identifies substantive flaws in 42% of cases, with 97.7% of issues requiring actual computation to detect, and produces a publishable peer-review comment on a Nature Communications paper without human direction.
AIBullisharXiv – CS AI · Mar 267/10
🧠Researchers have developed AI-Supervisor, a multi-agent framework that maintains a persistent Research World Model to autonomously conduct end-to-end AI research supervision. Unlike traditional linear pipelines, the system uses specialized agents with structured gap discovery, self-correcting loops, and consensus mechanisms to continuously evolve research understanding.
AIBullisharXiv – CS AI · Mar 267/10
🧠Researchers have developed ML-Master 2.0, an autonomous AI agent that achieves breakthrough performance in ultra-long-horizon machine learning tasks by using Hierarchical Cognitive Caching architecture. The system achieved a 56.44% medal rate on OpenAI's MLE-Bench, demonstrating the ability to maintain strategic coherence over experimental cycles spanning days or weeks.
🏢 OpenAI
AIBullisharXiv – CS AI · Mar 167/10
🧠Researchers introduced QMatSuite, an open-source platform that enables AI agents to accumulate and apply knowledge across computational materials science experiments. The system demonstrated significant improvements, reducing reasoning overhead by 67% and improving accuracy from 47% to 3% deviation from literature benchmarks.
AINeutralarXiv – CS AI · Mar 117/10
🧠Researchers introduce PostTrainBench, a benchmark testing whether AI agents can autonomously perform LLM post-training optimization. While frontier agents show progress, they underperform official instruction-tuned models (23.2% vs 51.1%) and exhibit concerning behaviors like reward hacking and unauthorized resource usage.
🧠 GPT-5🧠 Claude🧠 Opus
AIBullisharXiv – CS AI · Mar 97/10
🧠Google DeepMind introduces Aletheia, an AI research agent powered by Gemini Deep Think that can autonomously conduct mathematical research from problem-solving to generating complete research papers. The system has successfully produced research papers without human intervention and solved four open mathematical problems from established databases.
🏢 Google🧠 Gemini
AINeutralarXiv – CS AI · Mar 56/10
🧠Researchers introduce PDR-Bench, the first benchmark for evaluating personalization in Deep Research Agents (DRAs), featuring 250 realistic user-task queries across 10 domains. The benchmark uses a new PQR Evaluation Framework to measure personalization alignment, content quality, and factual reliability in AI research assistants.
AIBullisharXiv – CS AI · Mar 37/102
🧠Researchers have developed FM Agent, a multi-agent AI framework that combines large language models with evolutionary search to autonomously solve complex research problems. The system achieved state-of-the-art results across multiple domains including operations research, machine learning, and GPU optimization without human intervention.
AINeutralarXiv – CS AI · Feb 277/107
🧠A research paper introduces the concept of 'vibe researching' where AI agents can autonomously execute entire research pipelines from idea to submission using specialized skills. The study analyzes how AI agents excel at speed and methodological tasks but struggle with theoretical originality and tacit knowledge, creating a cognitive rather than sequential delegation boundary in research workflows.
AINeutralarXiv – CS AI · Jun 86/10
🧠Researchers introduce CrowdMath, a dataset of 164 expert-annotated collaborative mathematical problem-solving discussions from MIT PRIMES and Art of Problem Solving (2016-2025). While frontier AI models achieve 83-88% accuracy in predicting next posts, they struggle significantly with understanding the functional roles of contributions in mathematical reasoning, revealing a gap between solving isolated problems and comprehending collaborative research progress.
AINeutralarXiv – CS AI · Jun 45/10
🧠Researchers propose an automated technique for generating research paper titles from abstracts using large language models, testing multiple approaches including fine-tuned PEGASUS and zero-shot GPT-3.5-turbo. Fine-tuned PEGASUS-large emerges as the top performer, though ChatGPT demonstrates creative title generation capabilities, suggesting AI-generated titles are practical and reliable for academic publishing workflows.
🧠 ChatGPT
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduce AutoMedBench, a comprehensive benchmark for evaluating autonomous AI agents on medical research workflows rather than isolated tasks. The framework stages agent execution across five phases and reveals that current models struggle most with validation and verification, despite excelling at pipeline setup.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduce AblationBench, a benchmark suite for evaluating language model agents on ablation planning tasks in AI research. The study finds that frontier LMs achieve only 45% accuracy on average, significantly below human performance, highlighting challenges in automating scientific research methodologies.
🏢 Hugging Face
AINeutralarXiv – CS AI · Jun 16/10
🧠Researchers introduce AutoSci, an AI-driven system designed to automate the full scientific research lifecycle by managing literature review, experiments, manuscript writing, and peer review responses. The system uses a memory-centric architecture with four specialized modules to maintain structured knowledge, execute research workflows, and continuously improve its procedures through feedback.
AIBullishGoogle DeepMind Blog · May 166/10
🧠Calico Life Sciences has implemented Co-Scientist, an AI tool designed to aggregate dispersed research findings and identify new research directions in aging studies. This application demonstrates how AI systems can accelerate scientific discovery by synthesizing complex datasets across multiple studies.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers have released LABBench2, an upgraded benchmark with nearly 1,900 tasks designed to measure AI systems' real-world capabilities in biology research beyond theoretical knowledge. The new benchmark shows current frontier models achieve 26-46% lower accuracy than on the original LAB-Bench, indicating significant progress in AI scientific abilities while highlighting substantial room for improvement.
$OP🏢 Hugging Face
AIBullisharXiv – CS AI · Mar 176/10
🧠Researchers introduce DOVA (Deep Orchestrated Versatile Agent), a multi-agent AI platform that improves research automation through deliberation-first orchestration and hybrid collaborative reasoning. The system reduces inference costs by 40-60% on simple tasks while maintaining deep reasoning capabilities for complex research requiring multi-source synthesis.
