AIBullisharXiv – CS AI · 7h ago7/10
🧠
Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speed
Researchers introduce Efficient-DLM, a framework for converting pretrained autoregressive language models into diffusion language models that enable parallel, non-autoregressive generation. The approach uses block-wise attention patterns and position-dependent masking to preserve model accuracy while achieving 4.5x higher throughput compared to existing models.