AIBullisharXiv – CS AI · Jun 47/10
🧠Researchers introduce SceneDiver, a new method that improves Vision-Language Models and Vision-Language-Action Models by reducing visual hallucinations through progressive scene understanding and focus planning. The approach uses a coarse-to-fine strategy to help AI systems distinguish task-relevant objects from distractors, with applications in robotic manipulation and navigation tasks.
AIBullisharXiv – CS AI · Mar 37/105
🧠Researchers propose Vid-LLM, a new video-based 3D multimodal large language model that processes video inputs without requiring external 3D data for scene understanding. The model uses a Cross-Task Adapter module and Metric Depth Model to integrate geometric cues and maintain consistency across 3D tasks like question answering and visual grounding.
AINeutralarXiv – CS AI · Jun 256/10
🧠Researchers introduce CASU, a new benchmark for evaluating Large Audio Language Models' ability to understand complex auditory scenes by integrating multiple acoustic layers—speech, sound events, and background environments—rather than processing them in isolation. The benchmark reveals that current LALMs struggle with holistic scene comprehension and require integration across all audio layers for effective real-world audio understanding.
AIBullisharXiv – CS AI · Jun 96/10
🧠Researchers demonstrate that large language models can automate the grounding of 3D scene objects to formal ontology classes without training, achieving 90-96% accuracy on kitchen scenes. This zero-shot approach eliminates reliance on brittle, manually curated dictionaries and represents a significant advance in knowledge graph construction for robotic task reasoning.
AINeutralarXiv – CS AI · Jun 86/10
🧠SCOUT is an online semantic exploration framework that enables robots to actively understand indoor environments by coupling real-time scene graph construction with uncertainty-guided traversal planning. The system builds 3D scene graphs with probabilistic object labels and structural relations, then uses uncertainty metrics to decide where robots should explore next, treating semantic scene completion as an operational objective rather than a passive mapping byproduct.
AINeutralarXiv – CS AI · Jun 26/10
🧠GeoSAM-3D introduces a novel approach to 3D scene segmentation from monocular video by combining foundation models with Gaussian Splatting and geodesic propagation, enabling users to segment objects with simple clicks or text prompts without requiring RGB-D cameras or pre-reconstructed meshes.
AINeutralarXiv – CS AI · Jun 15/10
🧠Researchers propose an adaptive feature-selection system for 3D scene reconstruction that intelligently prioritizes visual data based on texture, repeatability, and geometric utility rather than using fixed thresholds. The method demonstrates improved reconstruction quality and computational efficiency across diverse scene types compared to baseline approaches, offering a modular enhancement for both classical and neural reconstruction pipelines.
AINeutralarXiv – CS AI · May 286/10
🧠Researchers introduce SegWorld, a segmentation model that uses visual chain-of-thought reasoning to understand scenes and segment object parts based on high-level intent rather than explicit target descriptions. The model proactively observes scenes, infers affordances, and maps user instructions to specific physical interaction points, outperforming baselines on intent-level tasks while matching them on traditional target-referential instructions.
AINeutralarXiv – CS AI · May 285/10
🧠Researchers propose Manboformer, an improvement to GaussianFormer that enhances 3D semantic occupancy prediction for autonomous driving by incorporating spatial-temporal attention mechanisms. The method addresses performance limitations in the original Gaussian-based approach by leveraging temporal information, with evaluation ongoing on the NuScenes dataset.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers introduce PaGeR, a framework that adapts 3D foundation models trained on perspective images to work with panoramic imagery, enabling geometry estimation from 360-degree scenes. The unified model predicts depth, surface normals, and sky masks from both standard and panoramic images in a single pass, achieving state-of-the-art performance on indoor and outdoor scenes.
AIBullisharXiv – CS AI · Mar 176/10
🧠Researchers propose CroBo, a new visual state representation learning framework that helps robotic agents better understand dynamic environments by encoding both semantic identities and spatial locations of scene elements. The framework uses a global-to-local reconstruction method that compresses observations into compact tokens, achieving state-of-the-art performance on robot policy learning benchmarks.
AIBullisharXiv – CS AI · Mar 26/1017
🧠Researchers have developed LiteReality, a novel pipeline that converts RGB-D scans of indoor environments into compact, realistic 3D virtual replicas suitable for AR/VR, gaming, robotics, and digital twins. The system features scene understanding, object retrieval, material painting, and physics integration to create graphics-ready environments that support object individuality and physically-based rendering.
AINeutralarXiv – CS AI · Apr 74/10
🧠TreeGaussian introduces a new framework for 3D scene understanding that uses tree-guided cascaded contrastive learning to better capture hierarchical semantic relationships in complex 3D environments. The method addresses limitations in existing 3D Gaussian Splatting approaches by implementing structured learning across object-part hierarchies and improving segmentation consistency.
