WaveFilter: Enhancing the Long-Context Capability of Diffusion LLMs via Wavelet-Guided KV Cache Filtering
Researchers introduce WaveFilter, a training-free framework that uses wavelet transforms to optimize Key-Value cache filtering in Diffusion Large Language Models, addressing computational bottlenecks in long-context processing. The technique enables sparse KV caching to maintain generation quality while reducing inference latency, offering plug-and-play compatibility with existing LLM architectures.