AIBullisharXiv – CS AI · 7h ago7/10
🧠
Multimodal Function Vectors for Visual Relations
Researchers demonstrate that Large Multimodal Models encode visual relational knowledge in specific attention heads called function vectors, which can be extracted and manipulated to improve performance on relational tasks. These vectors can be fine-tuned with minimal data while keeping model parameters frozen, and can be linearly combined to solve novel analogy problems, advancing understanding of how multimodal AI systems process visual relationships.