AINeutralarXiv – CS AI · 18h ago6/10
🧠
Q-Delta: Beyond Key-Value Associative State Evolution
Q-Delta presents a novel approach to linear attention mechanisms in sequence modeling by integrating query-conditioned state evolution, moving beyond traditional key-value associative paradigms. The method combines efficient linear-time inference with improved performance on language modeling and long-context retrieval tasks through a hardware-optimized implementation.