#heavy-tailed-distributions News & Analysis

2 articles tagged with #heavy-tailed-distributions. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 46/10

🧠

Markov Chain Decoders Overcome the Heavy-Tail Limitations of Lipschitz Generative Models

Researchers demonstrate that standard generative models cannot produce heavy-tailed distributions due to Gaussian decoder limitations and Lipschitz constraints. They propose replacing Gaussian decoders with Phase-Type distributions based on Markov chains, achieving up to 10x improvement in extreme quantile error for heavy-tailed data generation.

AINeutralarXiv – CS AI · Apr 146/10

🧠

Tail-Aware Information-Theoretic Generalization for RLHF and SGLD

Researchers develop a new information-theoretic framework that handles heavy-tailed data distributions, addressing limitations in classical generalization bounds used in machine learning. The work applies specifically to reinforcement learning from human feedback (RLHF) and stochastic gradient optimization, where traditional KL-divergence tools fail due to non-existent moment generating functions.