3 articles tagged with #speech-language-models. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
AuRA is a novel method that distills audio understanding directly into large language models through LoRA adaptation, eliminating the need for cascaded ASR pipelines or costly multimodal training. The technique achieves superior performance and efficiency compared to existing speech-language approaches by enabling parallel end-to-end inference while reusing pretrained models.
Researchers demonstrate that large speech language models contain significant redundancy in their token representations, particularly in deeper layers. By introducing Affinity Pooling, a training-free token merging technique, they achieve 27.48% reduction in prefilling FLOPs and up to 1.7× memory savings while maintaining semantic accuracy, challenging the necessity of fully distinct tokens for acoustic processing.
Researchers propose ASPIRin, a reinforcement learning framework that improves full-duplex speech language models by separating turn-taking decisions from semantic generation. The method reduces repetitive output by over 50% compared to standard approaches while maintaining natural conversational dynamics.
