Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Study
Researchers conducted the first systematic analysis of five state-of-the-art Automated Program Repair agents across 500 real-world tasks, revealing that while LLM-based agents excel at simple fixes, they struggle with logic-intensive bugs and lack access to proper debugging tools. The study identifies critical limitations in current APR systems, including poor test generation capabilities and primitive tooling, proposing that next-generation systems require richer tool ecosystems and better benchmark metrics.