Tool-Genesis: A Task-Driven Tool Creation Benchmark for Self-Evolving Language Agent

Researchers introduce Tool-Genesis, a new benchmark for evaluating self-evolving AI agents' ability to create and use tools from abstract requirements. The study reveals that even advanced AI models struggle with creating precise tool interfaces and executable logic, with small initial errors causing significant downstream performance degradation.