5 articles tagged with #neural-audio. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers have developed dots.tts, a 2-billion parameter text-to-speech model that achieves state-of-the-art performance through innovations in continuous speech modeling, full-history conditioning, and self-corrective training. The model demonstrates exceptional multilingual capabilities and enables low-latency speech generation, with code and weights released open-source under Apache 2.0 license.
Researchers introduce OscillaTTS, a diffusion-based text-to-speech system that uses adaptive oscillatory nonlinearity to better model sharp prosodic transitions and rapid pitch variations in expressive speech. The approach improves upon existing methods that rely on fixed periodic activation functions, demonstrating consistent improvements in both objective metrics and subjective evaluations on standard speech datasets.
Researchers introduce S5-TTS, a streaming variant of T5-based text-to-speech that generates speech word-by-word with minimal latency by processing limited lookahead context. The system uses novel masking mechanisms and distillation techniques to maintain speech quality and speaker similarity while enabling real-time conversational AI applications.
Researchers introduce BareWave, a waveform-native text-to-speech system using flow-matching that eliminates intermediate acoustic representations and separate decoding stages. The framework addresses three key training challenges—lack of representational scaffolding, noise schedule optimization, and perceptual objective alignment—while maintaining inference without pretrained components, demonstrating competitive results in zero-shot voice cloning.
Researchers introduce Chatterbox-Flash, a zero-shot text-to-speech model combining block-diffusion decoding with streaming capabilities. The system addresses token distribution bias through prior-calibrated scoring and early-decoding schedules, achieving high-fidelity speech synthesis with low latency comparable to autoregressive systems.
