Making Foresight Actionable: Repurposing Representation Alignment in World Action Models
Researchers introduce AGRA, a new objective function that improves World Action Models (WAMs) for robot manipulation by aligning video diffusion features with semantic representations, solving the problem where visually plausible predictions don't translate to accurate control actions. The method enhances action decoder focus on task-relevant regions and improves robustness to task-irrelevant perturbations in both in-distribution and out-of-distribution scenarios.