#multimodal-fusion News & Analysis

6 articles tagged with #multimodal-fusion. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

6 articles

AINeutralarXiv – CS AI · Jun 96/10

🧠

NeuroAlign: Hierarchical Multimodal Fusion of Dynamic and Structural Neuroimaging for MCI Analysis

NeuroAlign presents a hierarchical machine learning framework that fuses functional MRI and diffusion tensor imaging data to improve detection of mild cognitive impairment. The system introduces novel alignment and interaction mechanisms between multimodal neuroimaging datasets, with a new attribution method for interpretability, demonstrating competitive results across multiple medical imaging datasets.

AINeutralarXiv – CS AI · Jun 86/10

🧠

IRAF: Interference-Resilient Adaptive Fusion for Noise-Robust End-to-End Full-Duplex Spoken Dialogue Systems

Researchers propose IRAF, a lightweight module that improves full-duplex spoken dialogue systems by filtering interference from background speakers. The technology uses adaptive fusion to modulate user audio reliability frame-by-frame, demonstrating improved response quality and stable turn-taking in noisy acoustic environments.

AINeutralarXiv – CS AI · Jun 56/10

🧠

Step-adaptive multimodal fusion network with multi-scale cloud feature learning for ultra-short-term solar irradiance forecasting

Researchers propose a step-adaptive multimodal fusion network for ultra-short-term solar irradiance forecasting that combines cloud image analysis with meteorological data. The model addresses limitations in existing approaches by using InceptionNeXt for multi-scale cloud feature extraction and dynamic low-frequency compensation that adapts to different prediction horizons.

AINeutralarXiv – CS AI · May 126/10

🧠

Hyperbolic Distillation: Geometry-Guided Cross-Modal Transfer for Robust 3D Object Detection

Researchers propose HGC-Det, a hyperbolic geometry-based cross-modal distillation framework for 3D object detection that integrates point cloud and image data more effectively. The method addresses modality heterogeneity and spatial misalignment issues through three specialized components and demonstrates improved performance across indoor and outdoor datasets.

AIBullisharXiv – CS AI · Apr 156/10

🧠

TimeSAF: Towards LLM-Guided Semantic Asynchronous Fusion for Time Series Forecasting

TimeSAF introduces a hierarchical asynchronous fusion framework that improves how large language models guide time series forecasting by decoupling semantic understanding from numerical dynamics. This addresses a fundamental architectural limitation in existing methods and demonstrates superior performance on standard benchmarks with strong generalization capabilities.

AIBullisharXiv – CS AI · Mar 36/108

🧠

SurgFusion-Net: Diversified Adaptive Multimodal Fusion Network for Surgical Skill Assessment

Researchers developed SurgFusion-Net, a multimodal AI system for assessing surgical skills in robotic-assisted surgery. The system introduces new clinical datasets and fusion techniques that outperform existing baselines, addressing the domain gap between simulation and real clinical environments.