AIBullisharXiv โ CS AI ยท 4h ago5
๐ง
DiffuMamba: High-Throughput Diffusion LMs with Mamba Backbone
Researchers introduce DiffuMamba, a new diffusion language model using Mamba backbone architecture that achieves up to 8.2x higher inference throughput than Transformer-based models while maintaining comparable performance. The model demonstrates linear scaling with sequence length and represents a significant advancement in efficient AI text generation systems.