AIBullisharXiv – CS AI · Mar 37/106
🧠
Spectral Attention Steering for Prompt Highlighting
Researchers introduce SEKA and AdaSEKA, new training-free methods for attention steering in AI models that work with memory-efficient implementations like FlashAttention. These techniques enable better prompt highlighting by directly editing key embeddings using spectral decomposition, offering significant performance improvements with lower computational overhead.