AIBullisharXiv – CS AI · Jun 57/10
🧠
Benchmark Everything Everywhere All at Once
Researchers introduce Benchmark Agent, an autonomous AI system that automates the creation of machine learning benchmarks to address labor-intensive construction and performance saturation issues. The framework successfully generated 15 diverse benchmarks across text and multimodal understanding tasks, demonstrating that continually evolving benchmarks can accelerate LLM and MLLM development with minimal human oversight.