AINeutralarXiv – CS AI · 18h ago5/10
🧠
Frequency-Domain Latent Attention Gating for Cross-Domain Token Aggregation
Researchers introduce FLaG, a novel token aggregation module that applies frequency-domain analysis via FFT to improve how transformer models combine token representations into predictions. The method shows notable performance gains on protein structure prediction and image classification tasks while maintaining competitiveness on text benchmarks.