#decoder-only News & Analysis

2 articles tagged with #decoder-only. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Jun 86/10

🧠

WAV: Multi-Resolution Block Residual Routing for Deep Decoder-Only Transformers

Researchers introduce WAV v1, a multi-resolution residual routing technique that improves deep transformer training by capturing directional detail in residual connections beyond simple block summaries. The method shows significant performance gains at 48-layer depths, reducing validation loss by 2.2% on TinyStories and 0.6% on Text8 with minimal parameter overhead.

AIBullisharXiv – CS AI · Jun 16/10

🧠

DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs

Researchers introduce DOA (Decoder-Only Attention), a training-free method that enables simultaneous speech-to-text translation using decoder-only SpeechLLMs by extracting alignment signals from self-attention mechanisms. The approach achieves low-latency, long-form translation quality comparable to offline decoding without requiring model retraining.