AIBullisharXiv – CS AI · 10h ago7/10
🧠
From Markov to Laplace: How Mamba In-Context Learns Markov Chains
Researchers demonstrate that Mamba, a state space model alternative to transformers, efficiently learns optimal statistical estimators for Markov chains through in-context learning. The study reveals that single-layer Mamba discovers the Laplacian smoothing estimator—which is both Bayes and minimax optimal—and theoretically explains this capability through convolution-based representation.