AIBullisharXiv – CS AI · 9h ago7/10
🧠
DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions
Researchers introduce DragOn, a large-scale benchmark dataset with 286K training screenshots and 3.5M tasks designed to improve GUI agents' ability to perform drag-based interactions like highlighting, resizing, and swiping. The dataset addresses a critical gap where drag-grounding capabilities lag significantly behind click-grounding in AI models controlling desktops and mobile devices.
🧠 Claude