ComplexMCP: Evaluation of LLM Agents in Dynamic, Interdependent, and Large-Scale Tool Sandbox
Researchers introduced ComplexMCP, a benchmark for evaluating large language model agents in realistic, complex environments with interdependent tools and environmental noise. Testing revealed that current LLMs achieve only 60% success rates compared to 90% human performance, identifying three critical failure modes: tool retrieval saturation, over-confidence, and strategic defeatism.
