AINeutralarXiv – CS AI · 3h ago6/10
🧠
Harness-Bench: Measuring Harness Effects across Models in Realistic Agent Workflows
Researchers introduce Harness-Bench, a diagnostic benchmark that measures how software infrastructure—not just base models—affects LLM agent performance across realistic workflows. The study of 5,194 execution trajectories reveals substantial variation in agent capability depending on harness configuration, suggesting performance metrics should reflect model-harness pairings rather than models alone.