AIBullisharXiv – CS AI · 7h ago7/10
🧠
DSL-LLaDA: Scaling Continuous Denoising to 8B Masked Diffusion LMs
Researchers have developed DSL-LLaDA, an 8-billion parameter masked diffusion language model that addresses the quality-versus-length tradeoff in fast text generation by adopting continuous embedding-space denoising instead of discrete token unmasking. Adapted from LLaDA-8B with minimal additional training, the model achieves superior summarization performance on low-step inference budgets while demonstrating robustness to corrupted input tokens.