Markov Chain Decoders Overcome the Heavy-Tail Limitations of Lipschitz Generative Models
Researchers demonstrate that standard generative models cannot produce heavy-tailed distributions due to Gaussian decoder limitations and Lipschitz constraints. They propose replacing Gaussian decoders with Phase-Type distributions based on Markov chains, achieving up to 10x improvement in extreme quantile error for heavy-tailed data generation.