AINeutralarXiv – CS AI · 6h ago6/10
🧠
HNC: Leveraging Hard Negative Captions towards Models with Fine-Grained Visual-Linguistic Comprehension Capabilities
Researchers introduce Hard Negative Captions (HNC), an automatically generated dataset designed to improve vision-language models' ability to understand fine-grained mismatches between images and text. The work addresses a fundamental limitation in current image-text matching approaches, where weakly paired web data fails to teach models detailed cross-modal comprehension, demonstrating improved performance on diagnostic tasks and robustness under noisy conditions.