Understanding the Challenges in Iterative Generative Optimization with LLMs

Research reveals that iterative generative optimization with LLMs faces significant practical challenges, with only 9% of surveyed agents using automated optimization. The study identifies three critical design factors that determine success: starting artifacts, credit horizon for execution traces, and batching of learning evidence.