AINeutralarXiv – CS AI · 14h ago7/10
🧠
A Mathematical Explanation of Transformers
Researchers propose a novel mathematical framework interpreting Transformers as discretized integro-differential equations, revealing self-attention as a non-local integral operator and layer normalization as time-dependent projection. This theoretical foundation bridges deep learning architectures with continuous mathematical modeling, offering new insights for architecture design and interpretability.