AIBearisharXiv – CS AI · Jun 237/10
🧠Researchers have identified a sophisticated vulnerability in multimodal AI web agents through MIRAGE, a visual prompt injection attack that exploits trusted web platforms by embedding hidden adversarial instructions within legitimate ad slots or widgets. The attack demonstrates how constrained attackers can manipulate MLLM-based automation tools like SeeAct and OpenClaw without detection, raising critical security concerns for AI-powered browser automation systems.
AIBullisharXiv – CS AI · Jun 237/10
🧠Researchers introduce VideoLatent, a multimodal language model that performs efficient visual reasoning on videos without requiring labor-intensive chain-of-thought annotations. The model uses a novel latent self-forcing training paradigm and achieves superior performance across 14 benchmarks while reducing computational overhead by 6-68x compared to existing methods.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers introduce ACTIVE-o3, a reinforcement learning framework that enables Multimodal Large Language Models (MLLMs) to actively perceive and intelligently select regions of interest for visual analysis. The system outperforms GPT-o3's zoom strategy while maintaining general understanding capabilities, with applications spanning robotics, autonomous driving, and remote sensing.
AIBearisharXiv – CS AI · Jun 87/10
🧠Researchers introduce EVA, an evolutionary framework that demonstrates GUI agents powered by multimodal language models are vulnerable to Environmental Injection Attacks through semantic deception rather than visual manipulation, achieving 85% attack success rates and revealing a critical security flaw in instruction-following alignment training.
AIBullisharXiv – CS AI · Jun 57/10
🧠Researchers introduce Active Video Perception (AVP), an AI framework that enables agents to actively seek relevant evidence in long videos rather than passively processing entire content. The system uses an iterative plan-observe-reflect process to achieve superior accuracy on five benchmarks while reducing inference time by 82% and token usage by 88% compared to existing agentic methods.
AINeutralarXiv – CS AI · May 287/10
🧠Researchers introduce EgoBench, a new benchmark for evaluating AI agents' ability to perceive visual information, reason through multi-step tasks, and interact with users in real-world scenarios. Testing eight state-of-the-art video models reveals significant limitations, with the best performer achieving only 30.62% accuracy, exposing critical gaps in current AI agent capabilities.
AIBullisharXiv – CS AI · May 287/10
🧠Researchers introduce ESRT, a privacy-preserving edge-cloud framework for multilingual speech-to-text translation that processes voice data locally while transmitting only compressed features to the cloud. The system achieves state-of-the-art performance across 45 languages while reducing bandwidth requirements by 10x and preventing voiceprint leakage.
AIBullisharXiv – CS AI · May 287/10
🧠Researchers introduce VITAL, a latent-space reasoning framework for medical AI models that uses dual visual-semantic supervision to improve medical visual question answering while maintaining interpretability. The method addresses modality collapse and inference efficiency issues in existing approaches, achieving state-of-the-art results on 7 benchmarks using a newly constructed 61K medical imaging dataset.
AIBullisharXiv – CS AI · May 127/10
🧠Researchers introduce GuardAD, a safety framework that enhances autonomous driving systems using multimodal large language models (MLLMs) by incorporating Markovian logic to detect and prevent accidents. The model-agnostic safeguard reduces accident rates by 32% while improving task performance, combining neuro-symbolic logic with dynamic action revision rather than simple action veto mechanisms.
AIBullisharXiv – CS AI · Apr 77/10
🧠Researchers introduce V-Reflection, a new framework that transforms Multimodal Large Language Models (MLLMs) from passive observers to active interrogators through a 'think-then-look' mechanism. The approach addresses perception-related hallucinations in fine-grained tasks by allowing models to dynamically re-examine visual details during reasoning, showing significant improvements across six perception-intensive benchmarks.
AINeutralarXiv – CS AI · Apr 67/10
🧠Researchers propose the Hallucination-as-Cue Framework to analyze reinforcement learning's effectiveness in training multimodal AI models. The study reveals that RL training can improve reasoning performance even under hallucination-inductive conditions, challenging assumptions about how these models learn from visual information.
AIBearisharXiv – CS AI · Mar 267/10
🧠Research reveals that multimodal large language models (MLLMs) pose greater safety risks than diffusion models for image generation, producing more unsafe content and creating images that are harder for detection systems to identify. The enhanced semantic understanding capabilities of MLLMs, while more powerful, enable them to interpret complex prompts that lead to dangerous outputs including fake image synthesis.
AIBullisharXiv – CS AI · Mar 177/10
🧠Researchers introduce PRIMO R1, a 7B parameter AI framework that transforms video MLLMs from passive observers into active critics for robotic manipulation tasks. The system uses reinforcement learning to achieve 50% better accuracy than specialized baselines and outperforms 72B-scale models, establishing state-of-the-art performance on the RoboFail benchmark.
🏢 OpenAI🧠 o1
AIBullisharXiv – CS AI · Mar 177/10
🧠Researchers developed AD-Copilot, a specialized multimodal AI assistant for industrial anomaly detection that outperforms existing models and even human experts. The system uses a novel visual comparison approach and achieved 82.3% accuracy on benchmarks, representing up to 3.35x improvement over baselines.
🏢 Microsoft
AINeutralarXiv – CS AI · Mar 117/10
🧠Researchers introduce OOD-MMSafe, a new benchmark revealing that current Multimodal Large Language Models fail to identify hidden safety risks up to 67.5% of the time. They developed CASPO framework which dramatically reduces failure rates to under 8% for risk identification in consequence-driven safety scenarios.
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers successfully developed multimodal large language models for Basque, a low-resource language, finding that only 20% Basque training data is needed for solid performance. The study demonstrates that specialized Basque language backbones aren't required, potentially enabling MLLM development for other underrepresented languages.
🧠 Llama
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers developed EvoPrune, a new method that prunes visual tokens during the encoding stage of Multimodal Large Language Models (MLLMs) rather than after encoding. The technique achieves 2x inference speedup with less than 1% performance loss on video datasets, addressing efficiency bottlenecks in AI models processing high-resolution images and videos.
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers introduce GeoSeg, a zero-shot, training-free framework for AI-driven segmentation of remote sensing imagery that uses multimodal language models for reasoning without requiring specialized training data. The system addresses domain-specific challenges in satellite and aerial image analysis through bias-aware coordinate refinement and dual-route prompting mechanisms.
AINeutralarXiv – CS AI · Mar 56/10
🧠Researchers introduced WebRRSBench, a comprehensive benchmark evaluating multimodal large language models' reasoning, robustness, and safety capabilities for web understanding tasks. Testing 11 MLLMs on 3,799 QA pairs from 729 websites revealed significant gaps in compositional reasoning, UI robustness, and safety-critical action recognition.
AIBullisharXiv – CS AI · Mar 46/104
🧠A large-scale benchmarking study finds that powerful Multimodal Large Language Models (MLLMs) can extract information from business documents using image-only input, potentially eliminating the need for traditional OCR preprocessing. The research demonstrates that well-designed prompts and instructions can further enhance MLLM performance in document processing tasks.
AINeutralarXiv – CS AI · Mar 37/104
🧠Researchers introduce Interaction2Code, the first benchmark for evaluating Multimodal Large Language Models' ability to generate interactive webpage code from prototypes. The study identifies four critical limitations in current MLLMs and proposes enhancement strategies to improve their performance on dynamic web interactions.
AINeutralarXiv – CS AI · Mar 37/103
🧠Researchers introduced MMR-Life, a comprehensive benchmark with 2,646 questions and 19,108 real-world images to evaluate multimodal reasoning capabilities of AI models. Even top models like GPT-5 achieved only 58% accuracy, highlighting significant challenges in real-world multimodal reasoning across seven different reasoning types.
AINeutralarXiv – CS AI · Jun 256/10
🧠Researchers introduce OPPO, a reinforcement learning framework designed to improve how multimodal AI systems (Omni-MLLMs) understand emotion by better integrating visual, acoustic, and textual information. The method addresses critical failures where systems hallucinate cross-modal information and fail to fully utilize available data, achieving state-of-the-art results on emotion recognition benchmarks.
AINeutralarXiv – CS AI · Jun 196/10
🧠Researchers introduce PerceptionDLM, a multimodal diffusion language model that enables parallel processing of multiple image regions simultaneously, rather than sequentially. The innovation improves inference efficiency for visual perception tasks while maintaining competitive caption quality, accompanied by a new benchmark for evaluating parallel region captioning.
AINeutralarXiv – CS AI · Jun 196/10
🧠Researchers introduce RS-Neg, the first benchmark for evaluating negation comprehension in Remote Sensing Multimodal Large Language Models, revealing significant limitations in understanding what is absent or false. They propose NeFo, a test-time learning method that improves negation understanding using just 5% of unlabeled samples, addressing a critical gap for real-world emergency response applications.
