AIBullisharXiv – CS AI · May 127/10
🧠Researchers identify a fundamental geometric flaw in decoder-based Vision-Language Models where visual embeddings become over-aligned with linguistic patterns, causing systematic hallucinations. The study introduces quantitative methods to characterize this bias and proposes training-free and fine-tuning solutions that reduce hallucinations across multiple benchmarks without computational overhead.
AIBullisharXiv – CS AI · May 117/10
🧠Researchers propose a new training paradigm called ReVision that addresses the 'modality gap'—a geometric misalignment between visual and text embeddings in multimodal AI models. By introducing ReAlign, a training-free alignment strategy that leverages unpaired data statistics, the framework enables efficient scaling of multimodal large language models without requiring expensive paired image-text datasets.
AINeutralarXiv – CS AI · Jun 116/10
🧠DiffCold presents a diffusion-based generative model addressing the cold-start recommendation problem in collaborative filtering systems. The approach resolves the inherent performance trade-off between new and established items by using conditional diffusion to unify their embedding representations while preserving structural integrity.
AINeutralarXiv – CS AI · Jun 86/10
🧠Researchers introduce TEVI, a framework using sparse autoencoders to improve vision-language alignment in models like CLIP by selectively filtering image embeddings based on text captions. The method addresses a fundamental information imbalance where images contain more data than captions describe, demonstrating improved retrieval performance across multiple benchmarks.
AINeutralarXiv – CS AI · Jun 16/10
🧠Researchers present a novel technique for matching vectors across different AI embedding models trained independently on overlapping datasets. The method leverages local geometric consistency in contrastive encoders to establish cross-model correspondences using only a small seed set of paired anchors, with applications to vector database integration.
AIBullisharXiv – CS AI · Mar 174/10
🧠Researchers have developed LAMB, a new AI framework that improves automated audio captioning by better aligning audio features with large language models through Cauchy-Schwarz divergence optimization. The system achieved state-of-the-art performance on AudioCaps dataset by bridging the modality gap between audio and text embeddings.