AIBullisharXiv – CS AI · 9h ago7/10
🧠
Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation
Researchers present Trajectory-Shaped Discrete Flow Matching (TS-DFM), a technique that improves text generation efficiency by using an energy-based guidance system during training to select better token transformation paths. The method enables a compact student model to achieve 32% lower perplexity than a 1,024-step teacher while running 128x faster at just 8 steps, setting new benchmarks for discrete generation tasks.
🏢 Perplexity