#post-training-adaptation News & Analysis

Simple Self-Conditioning Adaptation for Masked Diffusion Models

Researchers propose Self-Conditioned Masked Diffusion Models (SCMDM), a post-training adaptation that improves discrete sequence generation by conditioning each denoising step on previous predictions rather than discarding them. The method achieves nearly 50% perplexity reduction on language models and demonstrates improvements across image synthesis, molecular generation, and genomic modeling without requiring architectural changes or extra computational costs.