AINeutralarXiv – CS AI · Jun 196/10
🧠
ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments
Researchers introduce ScholarQuest, a large-scale benchmark for evaluating AI agents that search academic papers using language models. The benchmark tests agents across 1,000+ computer science topics with four research intent types, revealing that current agentic methods significantly outperform basic retrieval but still achieve only 31-36% recall, exposing substantial performance gaps in AI-driven literature discovery.