AINeutralarXiv – CS AI · 15h ago6/10
🧠
AgentAtlas: Beyond Outcome Leaderboards for LLM Agents
AgentAtlas introduces a comprehensive diagnostic framework for evaluating LLM agents beyond simple success/failure metrics, proposing a six-state control-decision taxonomy and trajectory-failure vocabulary to expose behavioral patterns hidden by outcome-only leaderboards. The research demonstrates that evaluation methodology significantly impacts apparent model performance rankings.