#function-vectors News & Analysis

2 articles tagged with #function-vectors. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Jun 27/10

🧠

Multimodal Function Vectors for Visual Relations

Researchers demonstrate that Large Multimodal Models encode visual relational knowledge in specific attention heads called function vectors, which can be extracted and manipulated to improve performance on relational tasks. These vectors can be fine-tuned with minimal data while keeping model parameters frozen, and can be linearly combined to solve novel analogy problems, advancing understanding of how multimodal AI systems process visual relationships.

AINeutralarXiv – CS AI · Mar 26/1015

🧠

Understanding In-Context Learning Beyond Transformers: An Investigation of State Space and Hybrid Architectures

Researchers conducted an in-depth analysis of in-context learning capabilities across different AI architectures including transformers, state-space models, and hybrid systems. The study reveals that while these models perform similarly on tasks, their internal mechanisms differ significantly, with function vectors playing key roles in self-attention and Mamba layers.