AIBullisharXiv – CS AI · 8h ago6/10
🧠
Don't Retrain, Align: Adapting Autoregressive LMs to Diffusion LMs via Representation Alignment
Researchers introduce REPR-ALIGN, a method that converts autoregressive language models into diffusion language models by aligning their internal representations rather than retraining from scratch. The approach achieves up to 4x training acceleration and demonstrates that semantic structures learned through next-token prediction can transfer across different generation orders.