AIBullisharXiv – CS AI · Jun 47/10
🧠Researchers introduce UniCAD, a unified benchmark and multi-modal large language model designed to advance CAD (Computer-Aided Design) research by enabling simultaneous learning across multiple tasks and input types. The framework processes text, images, sketches, and point clouds to perform point-to-CAD reconstruction, generation, and question answering, achieving state-of-the-art results across diverse benchmarks.
AIBullisharXiv – CS AI · Mar 177/10
🧠Researchers introduce A.DOT Planner, an AI framework that enables multi-hop question answering across hybrid data lakes containing both structured and unstructured data. The system uses directed acyclic graphs to orchestrate complex queries, achieving 14.8% better accuracy and 10.7% better completeness than existing solutions.
$DOT
AIBullisharXiv – CS AI · Mar 37/104
🧠Researchers introduce Meta Engine, a unified semantic query system that integrates multiple specialized LLM-based query systems to handle multi-modal data analysis. The system addresses fragmentation in current semantic query tools by combining specialized systems through five key components, achieving 3-24x better performance than existing baselines.
AIBullisharXiv – CS AI · Jun 236/10
🧠Researchers propose CAMMST, a Masked Autoencoder framework that predicts gene expression from histology images by leveraging small amounts of spatial transcriptomics data as genetic anchors. The method combines visual and genetic modalities through contrastive learning, achieving superior performance with minimal transcriptomic coverage and addressing the cost limitations of spatial transcriptomics profiling.
AINeutralarXiv – CS AI · May 295/10
🧠Researchers introduce xModel-KD, a cross-modal knowledge distillation framework that combines 2D image data with 3D LiDAR point clouds to improve 3D scene segmentation with fewer labeled examples. The method achieves 2% absolute mIoU improvement over LiDAR-only approaches by leveraging complementary strengths of texture and geometric information through contrastive learning.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers propose DISS, a training-free framework that enhances diffusion-based image reconstruction by incorporating side information through inference-time search. The method demonstrates consistent quality improvements across multiple inverse problems (inpainting, super-resolution, deblurring) and diffusion solvers while supporting diverse side information types including reference images, text, and medical scans.
AIBullisharXiv – CS AI · Mar 276/10
🧠Researchers propose X-OPD, a Cross-Modal On-Policy Distillation framework to improve Speech Large Language Models by aligning them with text-based counterparts. The method uses token-level feedback from teacher models to bridge performance gaps in end-to-end speech systems while preserving inherent capabilities.
AINeutralarXiv – CS AI · Mar 126/10
🧠Researchers introduce FERRET, a new automated red teaming framework designed to generate multi-modal adversarial conversations to test AI model vulnerabilities. The framework uses three types of expansions (horizontal, vertical, and meta) to create more effective attack strategies and demonstrates superior performance compared to existing red teaming approaches.
AIBullisharXiv – CS AI · Mar 96/10
🧠Researchers introduce StreamWise, a system for real-time multi-modal content generation that can produce 10-minute podcast videos with sub-second startup delays. The system dynamically manages quality and resources across LLMs, text-to-speech, and video generation, costing under $25 for basic generation or $45 for high-quality real-time streaming.
AIBullisharXiv – CS AI · Mar 36/107
🧠Researchers propose REMIND, a framework for medical multi-modal AI learning that addresses the challenge of missing data across multiple modalities. The solution uses a Mixture-of-Experts architecture to handle long-tail distributions of modality combinations and shows superior performance on real-world medical datasets.
AINeutralarXiv – CS AI · Mar 264/10
🧠Researchers propose Text-guided Multi-view Knowledge Distillation (TMKD), a new method that uses dual-modality teachers (visual and text) to improve knowledge transfer from large AI models to smaller ones. The approach enhances visual teachers with multi-view inputs and incorporates CLIP text guidance, achieving up to 4.49% performance improvements across five benchmarks.
AIBullisharXiv – CS AI · Mar 95/10
🧠Researchers have developed GazeMoE, a new AI framework that uses Mixture-of-Experts architecture to accurately estimate where humans are looking by analyzing visual cues like eyes, head poses, and gestures. The system achieves state-of-the-art performance on benchmark datasets and addresses key challenges in gaze target detection through advanced multi-modal processing.
🏢 Hugging Face
AINeutralarXiv – CS AI · Mar 25/106
🧠Researchers developed M3TR, a new AI framework that uses temporal retrieval and multi-modal analysis to predict micro-video popularity with 19.3% better accuracy than existing methods. The system combines a Mamba-Hawkes Process module to model user feedback patterns with temporal-aware retrieval to identify historically relevant videos based on content and popularity trajectories.
$TR
AINeutralarXiv – CS AI · Mar 34/105
🧠Researchers propose DASP (Decoupling Adaptation for Stability and Plasticity), a novel framework for adapting multi-modal AI models to changing test environments. The method addresses key challenges of negative transfer and catastrophic forgetting by using asymmetric adaptation strategies that treat biased and unbiased modalities differently.
