#3d-awareness News & Analysis

2 articles tagged with #3d-awareness. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Jun 57/10

🧠

Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models

Researchers introduce GeoVR, a framework that enhances multimodal large language models with 3D spatial awareness by learning geometric representations from 2D video sequences. Using four complementary geometric targets including camera pose estimation, depth mapping, and 3D feature distillation, the approach achieves state-of-the-art performance on spatial reasoning benchmarks without requiring large-scale 3D training data.

AIBullisharXiv – CS AI · Jun 27/10

🧠

Towards 3D-Aware Video Diffusion Models: Render-Free Human Motion Control with Mesh Tokenization

Researchers propose a render-free framework for 3D-aware video diffusion models that uses compressed mesh tokens instead of 2D rendered guidance to control human motion in generated videos. By processing 3D geometric information directly alongside video tokens, the approach demonstrates improved performance on motion control tasks while reducing artifacts associated with traditional 2D guidance methods.