AIBullisharXiv – CS AI · Jun 87/10
🧠Researchers introduce LyraV, a streaming video-language model that maintains real-time synchronization between video perception and language generation without pausing. The system uses a hierarchical control framework with two key components—a Frame-Driven Transition Controller and Streaming Token Pacer—to interleave video frames with generated tokens at 3.89 FPS with 98.29% synchrony.
AIBullisharXiv – CS AI · Jun 27/10
🧠Researchers introduce V-LynX, a framework that enhances Video Large Language Models by integrating new sensory modalities through a lightweight auxiliary pathway rather than heavy encoders. The method aligns audio, 3D, and multi-view data with existing video understanding capabilities, achieving state-of-the-art results across multiple benchmarks without requiring paired supervision or freezing the base model.
AINeutralarXiv – CS AI · Apr 157/10
🧠Researchers have conducted a comprehensive survey on hallucinations in Video Large Language Models (Vid-LLMs), identifying two core types—dynamic distortion and content fabrication—and their root causes in temporal representation limitations and insufficient visual grounding. The study reviews evaluation benchmarks, mitigation strategies, and proposes future directions including motion-aware encoders and counterfactual learning to improve reliability.
AINeutralarXiv – CS AI · Mar 177/10
🧠Researchers introduced VideoSafetyEval, a benchmark revealing that video-based large language models have 34.2% worse safety performance than image-based models. They developed VideoSafety-R1, a dual-stage framework that achieves 71.1% improvement in safety through alarm token-guided fine-tuning and safety-guided reinforcement learning.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers introduce EgoExo-Con, a benchmark testing whether video language models maintain consistent temporal understanding across different camera viewpoints of the same event. The study reveals that existing Video-LLMs struggle with cross-view consistency and proposes View-GRPO, a reinforcement learning framework to improve temporal reasoning across viewpoints.
AINeutralarXiv – CS AI · Jun 96/10
🧠Researchers introduce CoVER, a new framework for Video Large Language Models that improves long-video understanding by gathering multiple search queries for visual evidence and using answer-specific visual feedback for verification. The approach demonstrates superior performance compared to similarly-sized models and some closed-source alternatives.
AINeutralarXiv – CS AI · May 116/10
🧠Response-G1 introduces a novel framework for real-time video understanding that uses explicit scene graphs to align video evidence with query-specific response conditions, enabling Video-LLMs to make more accurate timing decisions during streaming video analysis without requiring fine-tuning.
AINeutralarXiv – CS AI · May 16/10
🧠Researchers introduce VISE, the first benchmark for evaluating sycophancy in video large language models (Video-LLMs), where models incorrectly agree with user inputs that contradict visual evidence. The study proposes two training-free mitigation strategies: enhanced visual grounding through keyframe selection and inference-time neural representation steering, addressing a critical reliability gap in multimodal AI systems.
AIBearisharXiv – CS AI · Mar 37/108
🧠Researchers have discovered VidDoS, a new universal attack framework that can severely degrade Video-based Large Language Models by causing extreme computational resource exhaustion. The attack increases token generation by over 205x and inference latency by more than 15x, creating critical safety risks in real-world applications like autonomous driving.
AINeutralarXiv – CS AI · Mar 164/10
🧠Researchers developed a framework to improve video-language models' understanding of camera motion through geometric analysis. The study introduces CameraMotionDataset and CameraMotionVQA benchmark, revealing that current VideoLLMs struggle with camera motion recognition and proposing a lightweight solution using 3D foundation models.
