#affordance-learning News & Analysis

3 articles tagged with #affordance-learning. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AIBullisharXiv – CS AI · Jun 116/10

🧠

Making Foresight Actionable: Repurposing Representation Alignment in World Action Models

Researchers introduce AGRA, a new objective function that improves World Action Models (WAMs) for robot manipulation by aligning video diffusion features with semantic representations, solving the problem where visually plausible predictions don't translate to accurate control actions. The method enhances action decoder focus on task-relevant regions and improves robustness to task-irrelevant perturbations in both in-distribution and out-of-distribution scenarios.

AINeutralarXiv – CS AI · May 276/10

🧠

Advancing Creative Physical Intelligence in Large Multimodal Models

Researchers introduce MM-CreativityBench, a benchmark testing whether large multimodal models can solve creative physical problems by identifying non-obvious tool uses in constrained environments. Current LMMs struggle not from lack of generation capability but from poor visual grounding, hallucinating attributes and overlooking relevant entities; the team proposes affordance-grounded alignment using preference learning to improve performance.

AINeutralarXiv – CS AI · May 76/10

🧠

CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposing

Researchers introduce CreativityBench, a benchmark with 4K entities and 150K+ affordance annotations to evaluate how well large language models can creatively repurpose tools by reasoning about their properties rather than canonical uses. Evaluations across 10 state-of-the-art LLMs reveal significant limitations: models struggle to identify correct parts, affordances, and physical mechanisms needed for non-obvious solutions, with performance gains from scaling and reasoning strategies like Chain-of-Thought proving limited.