#videomae News & Analysis

2 articles tagged with #videomae. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 236/10

🧠

Deep Learning-Based Sign Language Recognition from Videos and Cross-Lingual Translation to Indian Vernaculars

Researchers have developed a deep learning pipeline that recognizes sign language gestures from videos and translates them into Indian languages using VideoMAE and Meta's NLLB-200 model. The system achieves 78% validation accuracy on a 13-class dataset and demonstrates practical accessibility applications, though it currently handles isolated words rather than continuous signing.

🏢 Meta

AINeutralarXiv – CS AI · Jun 96/10

🧠

Do Video Foundation Models Understand Intuitive Physics? A Layerwise Probing Analysis

Researchers analyzed whether pretrained video foundation models encode intuitive physics understanding by probing three model types (V-JEPA, VideoMAE, and LTX-Video) across frozen representations. Results show physics knowledge emerges reliably in intermediate-to-late layers, with V-JEPA performing strongest and temporal information proving critical for understanding physical dynamics.