y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#vlm-benchmarks News & Analysis

2 articles tagged with #vlm-benchmarks. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AIBearisharXiv – CS AI · Jun 17/10
🧠

Seeing Isn't Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)?

Researchers reveal that vision-language models (VLMs) fail to recognize when spatial questions cannot be reliably answered due to occlusion or perspective ambiguity, instead producing overconfident incorrect responses. The study introduces SpatialUncertain, a benchmark showing that current VLMs achieve only 30% accuracy under occlusion and below 10% under perspective challenges, highlighting a critical gap between answer correctness and epistemic awareness.

AINeutralarXiv – CS AI · Jun 26/10
🧠

MindClaw: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention

Researchers introduce MindClaw, a framework enabling robots to reason about human mental states in real-time and intervene with assistance only when genuinely helpful. The system extends Theory of Mind capabilities beyond offline recognition to closed-loop embodied assistance, outperforming direct vision-language model baselines by incorporating trigger-skill optimization for intervention calibration.