AIBullisharXiv – CS AI · 5d ago7/10
🧠RayDer introduces a unified transformer architecture that consolidates camera estimation, scene reconstruction, and rendering into a single model for self-supervised novel view synthesis from real-world video. The system achieves clean power-law scaling with data and compute while maintaining competitive performance with supervised approaches, addressing a key scalability challenge in 3D vision.
AIBullisharXiv – CS AI · May 297/10
🧠Researchers have introduced Archon, a unified multimodal AI model capable of generating holistic digital humans by integrating seven modalities including text, audio, motion, and video. The model employs novel techniques like semantic video reparameterization to reduce computational overhead while maintaining fidelity, potentially advancing avatar and metaverse applications.
AIBullisharXiv – CS AI · May 117/10
🧠Researchers present A²RD, an agentic autoregressive diffusion architecture designed to generate long-form videos with improved consistency and narrative coherence. The system uses a Retrieve-Synthesize-Refine-Update cycle across multiple components and demonstrates 30% improvements in consistency metrics compared to existing methods.
$RD
AIBullisharXiv – CS AI · Apr 147/10
🧠Researchers have developed an LLM-based framework that automatically generates safety-critical driving scenarios for autonomous vehicle testing using the CARLA simulator and realistic video synthesis. The system uses few-shot code generation to create diverse edge cases like pedestrian occlusions and vehicle cut-ins, bridging simulation and real-world realism through advanced video generation techniques.
AIBullisharXiv – CS AI · Mar 97/10
🧠Researchers introduce PSIVG, a framework that integrates physical simulators into AI video generation to ensure generated videos obey real-world physics like gravity and collision. The system reconstructs 4D scenes from template videos and uses physical simulations to guide video generators toward more realistic motion while maintaining visual quality.
AINeutralarXiv – CS AI · 4d ago6/10
🧠Researchers propose a new evaluation framework for audio-driven talking head generation that uses sequence-level alignment instead of frame-by-frame comparison. The method accounts for natural timing variations in speech-driven facial motion, providing more accurate assessment of generative model quality across different datasets and speaking styles.
AINeutralarXiv – CS AI · 4d ago6/10
🧠Researchers introduce Avatar Forcing, a new framework for generating interactive talking head avatars that respond to user inputs like speech and motion in real-time with approximately 500ms latency. The system uses diffusion forcing to enable multimodal interaction and a preference optimization method that learns expressive reactions without additional labeled data, achieving 80% preference over baseline models.
AIBullisharXiv – CS AI · May 276/10
🧠Researchers introduce E³C, a video diffusion framework enabling controllable egocentric video generation with 3D environmental memory and separate human pose controls for both camera wearers and observed subjects. The system addresses unique challenges in first-person video synthesis by maintaining scene consistency while handling rapid viewpoint changes and partial occlusions.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers propose Implicit Preference Alignment (IPA), a machine learning framework that improves hand motion generation in human image animation without requiring expensive paired preference data. The method uses self-generated samples and a hand-aware optimization mechanism to enhance animation quality while reducing data curation overhead.
AIBullisharXiv – CS AI · Mar 166/10
🧠Researchers introduce 'Narrative Weaver', a new AI framework that generates consistent long-form visual content across extended sequences, addressing a key limitation in current generative AI models. The system combines multimodal language models with novel control mechanisms and includes the release of a 330K+ image dataset for e-commerce advertising.
AIBullisharXiv – CS AI · Mar 36/104
🧠LiftAvatar is a new AI system that enhances 3D avatar animation by completing sparse monocular video observations in kinematic space using expression-controlled video diffusion Transformers. The technology addresses limitations in 3D Gaussian Splatting-based avatars by generating high-quality, temporally coherent facial expressions from single or multiple reference images.
