Grounding Computer Use Agents on Human Demonstrations
Researchers introduce GroundCUA, a large-scale desktop grounding dataset with 56K screenshots and 3.56M annotations from expert human demonstrations, enabling the development of GroundNext models that achieve state-of-the-art performance in mapping natural language instructions to UI elements while requiring significantly less training data than prior approaches.