3 articles tagged with #latent-actions. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers introduce Olaf-World, a new approach to training action-controllable video world models that solves the problem of action latents failing to transfer across different contexts. By anchoring latent actions to observable semantic effects rather than relying on scarce labeled data, the method achieves stronger zero-shot transfer and more efficient adaptation to new control interfaces.
Researchers introduce Residual Latent Action (RLA), a new latent action representation learned from DINO visual features, enabling more efficient and accurate world models that predict future visual features rather than raw pixels. RLA-WM outperforms existing feature-based and video-diffusion approaches while being orders of magnitude faster, with applications in robot learning from offline video demonstrations.
Researchers propose a novel reinforcement learning approach for fine-tuning multimodal conversational agents by learning a compact latent action space instead of operating directly on large text token spaces. The method combines paired image-text data with unpaired text-only data through a cross-modal projector trained with cycle consistency loss, demonstrating superior performance across multiple RL algorithms and conversation tasks.
