y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#transformer-theory News & Analysis

2 articles tagged with #transformer-theory. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AINeutralarXiv – CS AI · Jun 96/10
🧠

Reachability and asymptotics of Gaussian Transformer dynamics

Researchers have formulated Transformer data propagation as a nonlinear control system and proven that Gaussian distributions remain Gaussian through the network's layers. This reduces infinite-dimensional dynamics to finite-dimensional equations governing mean and covariance evolution, connecting Transformer expressiveness to classical control theory and revealing conditions for stability or divergence.

AINeutralarXiv – CS AI · May 276/10
🧠

A Sharper Picture of Generalization in Transformers

Researchers present a new theoretical framework for understanding how transformers generalize on boolean functions using PAC-Bayes theory and Fourier spectral analysis. The work provides non-vacuous generalization bounds for transformers and offers formal explanations for why chain-of-thought reasoning improves performance on complex tasks.