newsResearchers introduce MERaLiON2-Omni (Alpha), a 10B-parameter multilingual AI model designed for Southeast Asia that combines perception and reasoning capabilities. The study reveals an efficiency-stability paradox where reasoning enhances abstract tasks but causes instability in basic sensory processing like audio timing and visual interpretation.
Researchers have developed EMO-R3, a new framework that enhances emotional reasoning capabilities in Multimodal Large Language Models through reflective reinforcement learning. The approach introduces structured emotional thinking and reflective rewards to improve interpretability and emotional intelligence in visual understanding tasks.
Researchers introduce UMPIRE, a new training-free framework for quantifying uncertainty in Multimodal Large Language Models (MLLMs) across various input and output modalities. The system measures incoherence-adjusted semantic volume of model responses to better detect errors and improve reliability without requiring external tools or additional computational overhead.
Researchers introduce PointCoT, a new AI framework that enables multimodal large language models to perform explicit geometric reasoning on 3D point cloud data using Chain-of-Thought methodology. The framework addresses current limitations where AI models suffer from geometric hallucinations by implementing a 'Look, Think, then Answer' paradigm with 86k instruction-tuning samples.
Researchers have developed an 'Omnivorous Vision Encoder' that creates consistent feature representations across different visual modalities (RGB, depth, segmentation) of the same scene. The framework addresses the poor cross-modal alignment in existing vision encoders like DINOv2 by training with dual objectives to maximize feature alignment while preserving discriminative semantics.
Researchers propose a training-free solution to reduce hallucinations in multimodal AI models by rebalancing attention between perception and reasoning layers. The method achieves 4.2% improvement in reasoning accuracy with minimal computational overhead.
Researchers introduce Draw-In-Mind (DIM), a new approach to multimodal AI models that improves image editing by better balancing responsibilities between understanding and generation modules. The DIM-4.6B model achieves state-of-the-art performance on image editing benchmarks despite having fewer parameters than competing models.
Researchers developed Speculative Verdict (SV), a training-free framework that improves large Vision-Language Models' ability to reason over information-dense images by combining multiple small draft models with a larger verdict model. The approach achieves better accuracy on visual question answering benchmarks while reducing computational costs compared to large proprietary models.
DeepEyesV2 is a new agentic multimodal AI model that combines text and image comprehension with external tool integration like code execution and web search. The research introduces a two-stage training pipeline and RealX-Bench evaluation framework, demonstrating improved real-world reasoning capabilities through adaptive tool invocation.
Researchers developed DECO, a multimodal diffusion transformer for bimanual robot manipulation that integrates vision, proprioception, and tactile signals. The system achieved 72.25% success rate on complex manipulation tasks, with a 21% improvement over baseline methods when tested on over 2,000 robot rollouts.
Researchers introduced Resp-Agent, an AI system that uses multimodal deep learning to generate respiratory sounds and diagnose diseases. The system addresses data scarcity and representation gaps in medical AI through an autonomous agent-based approach and includes a new benchmark dataset of 229k recordings.
Researchers have developed a hierarchical AI agent system that can automatically modify urban planning layouts using natural language instructions and GeoJSON data. The system decomposes editing tasks into geometric operations across multiple spatial levels and includes validation mechanisms to ensure spatial consistency during multi-step urban modifications.
Researchers developed a multimodal gesture recognition system using Apple Watch sensors and custom gloves for hands-free drone and robot control in hazardous environments. The framework achieves performance comparable to vision-based systems while being more computationally efficient and robust to environmental conditions.