AIBearisharXiv – CS AI · Jun 237/10
🧠Researchers demonstrate the first systematic study of poisoning-based backdoor attacks on Speech Emotion Recognition (SER) systems using text-to-speech generated audio. The study reveals that modern SER models can be reliably compromised with imperceptible acoustic triggers while maintaining normal performance on benign inputs, exposing critical vulnerabilities in AI systems that process voice data.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers propose a fully end-to-end training framework that jointly optimizes all components of discrete-token-based text-to-speech systems—speech tokenizers, language models, diffusion models, and reward models—rather than training them independently. The approach achieves state-of-the-art results on benchmark tests with smaller, more efficient models.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers introduce TLDR, a patch-based autoregressive framework that compresses audio tokens to accelerate text-to-speech synthesis. The method achieves 1.8x inference speedup and reduces KV-cache memory by 75% without replacing existing model modules, addressing a key efficiency bottleneck in codec-based speech language models.
AIBullisharXiv – CS AI · Jun 87/10
🧠Researchers have developed dots.tts, a 2-billion parameter text-to-speech model that achieves state-of-the-art performance through innovations in continuous speech modeling, full-history conditioning, and self-corrective training. The model demonstrates exceptional multilingual capabilities and enables low-latency speech generation, with code and weights released open-source under Apache 2.0 license.
AIBullisharXiv – CS AI · Jun 57/10
🧠UniVoice is a unified AI model that generates both speech and singing from text using conditional flow matching, achieving performance comparable to dedicated speech systems while outperforming existing unified models for singing synthesis. The breakthrough lies in factorizing conditioning into content, melody, and timbre components, with melody constraints applied only to singing while speech prosody remains flexible.
AIBullisharXiv – CS AI · May 277/10
🧠PilotTTS demonstrates that competitive text-to-speech systems no longer require massive proprietary datasets or complex architectures. Using only 200K hours of openly-processed data and a lightweight autoregressive model, the system achieves industry-leading performance on benchmark tests while supporting voice cloning, emotion synthesis, and multilingual capabilities.
AIBullisharXiv – CS AI · May 97/10
🧠X-Voice is a 0.4B multilingual voice cloning model that enables zero-shot cross-lingual speech synthesis across 30 languages using a two-stage training approach with IPA as a unified representation. The open-sourced system achieves performance comparable to billion-scale models while eliminating the need for transcribed audio prompts, advancing accessibility in multilingual AI-generated speech.
AIBullisharXiv – CS AI · Mar 37/103
🧠Researchers have released WAXAL, a large-scale multilingual speech dataset covering 24 Sub-Saharan African languages representing over 100 million speakers. The dataset includes 1,250 hours of transcribed speech for ASR and 235 hours of high-quality recordings for TTS, released under CC-BY-4.0 license to advance inclusive AI technologies.
AIBullishOpenAI News · Sep 227/106
🧠SchoolAI has deployed AI infrastructure powered by OpenAI's GPT-4.1, image generation, and text-to-speech technology to serve 1 million classrooms globally. The platform focuses on providing safe, teacher-supervised AI tools that enhance student engagement and enable personalized learning experiences.
AIBullisharXiv – CS AI · Jun 256/10
🧠Researchers introduce CrossAccent-TTS, a machine learning framework that enables precise control over accent characteristics in cross-lingual text-to-speech systems. The technology uses an Accent Intensity Controller to allow smooth interpolation between accents while maintaining speaker identity, with particular applications for low-resource Indic languages.
AINeutralarXiv – CS AI · Jun 255/10
🧠Researchers introduce OscillaTTS, a diffusion-based text-to-speech system that uses adaptive oscillatory nonlinearity to better model sharp prosodic transitions and rapid pitch variations in expressive speech. The approach improves upon existing methods that rely on fixed periodic activation functions, demonstrating consistent improvements in both objective metrics and subjective evaluations on standard speech datasets.
AIBullisharXiv – CS AI · Jun 236/10
🧠Bagpiper-TTS is a universal speech synthesis system that uses natural language prompts to guide flexible speech generation, moving beyond rigid TTS frameworks. The model achieves competitive performance across multiple applications including multi-talker synthesis, singing voice synthesis, and intent-to-speech tasks, matching dedicated models while offering broader versatility.
AIBullisharXiv – CS AI · Jun 236/10
🧠Researchers introduce S5-TTS, a streaming variant of T5-based text-to-speech that generates speech word-by-word with minimal latency by processing limited lookahead context. The system uses novel masking mechanisms and distillation techniques to maintain speech quality and speaker similarity while enabling real-time conversational AI applications.
AINeutralarXiv – CS AI · Jun 235/10
🧠Researchers propose an imitation learning framework for text-to-speech synthesis tailored to older adults' comprehension needs, addressing limitations in current TTS systems designed for general audiences. The approach uses Group Relative Policy Optimization with two-stage on-policy reward learning to reduce data collection burden while improving model performance on accessibility metrics.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers present a novel framework for speaker verification in non-verbal vocalizations (NVVs) like laughter and sighs, combining Data2Vec features with ECAPA-TDNN and a Mixture of Experts module. The approach reduces speech-to-NVV error rates from 38.93% to 22.66% while maintaining speech verification accuracy, addressing a critical gap in voice authentication systems as TTS and voice conversion technologies become increasingly sophisticated.
AINeutralarXiv – CS AI · Jun 236/10
🧠EmoInstruct-TTS introduces a dual-path framework for emotional speech synthesis that enables fine-grained emotional control through natural language instructions. The system uses Emotion2embed, covering 48 emotional states, and an Instruction-Conditioned Emotion Flow Model to convert free-form text instructions into acoustically grounded emotion representations integrated with LLM-based synthesis pipelines.
AIBullisharXiv – CS AI · Jun 196/10
🧠Researchers introduce FlowEdit, a lifelong adaptation framework for text-to-speech systems that corrects pronunciation errors without retraining the underlying model. Using associative memory and latent conditioning edits, FlowEdit achieves 92.7% error reduction on multilingual proper nouns while maintaining speech quality and completing corrections in ~15 seconds.
AINeutralarXiv – CS AI · Jun 196/10
🧠Researchers propose a cross-attention attribution method for style-captioned text-to-speech systems, adapting the DAAM framework to speech diffusion models for the first time. Analysis of 3,600 style-caption and text combinations reveals how individual words influence acoustic output, showing that style tokens condition voice characteristics globally while peaking in early generation steps and deep network layers.
AINeutralarXiv – CS AI · Jun 196/10
🧠Researchers propose a code-mixing guided synthetic speech generation framework to improve automatic speech recognition (ASR) for multilingual code-switching scenarios. By optimizing synthetic data generation using the Code Mixing Index metric, the method demonstrates significant error rate reductions on Mandarin-English speech datasets, addressing a critical limitation in training data availability for code-switched ASR systems.
AINeutralarXiv – CS AI · Jun 106/10
🧠Researchers propose Self-EmoQ, an emotion-planning framework that determines emotional context before text generation to improve streaming emotional text-to-speech synthesis. The system uses reinforcement learning with Plutchik's emotion theory and demonstrates superior performance on multiple dialogue datasets, with a functional real-time deployment pipeline.
AINeutralarXiv – CS AI · Jun 105/10
🧠CANVAS is an automated AI system that generates rich, multi-sensory art descriptions and synchronized audio narration for museum collections and digital art, addressing accessibility gaps for blind and low-vision audiences. The system processes images through large language models and text-to-speech services via Zapier, producing detailed captions faster and cheaper than human alternatives while demonstrating superior lexical diversity compared to baseline alt-text.
AIBullisharXiv – CS AI · Jun 106/10
🧠Researchers demonstrate that FSQ (Finite Scalar Quantization) tokenization optimally structures latent space for continuous diffusion models applied to categorical data, offering a non-autoregressive alternative to large language models. Text-to-speech experiments validate FSQ's superiority, achieving better performance than LLM-based approaches while requiring smaller model sizes and faster inference.
AINeutralarXiv – CS AI · Jun 106/10
🧠Researchers have developed sparse autoencoders to interpret and control how language models process text-to-speech synthesis in CosyVoice3. The work demonstrates that interpretable features—phonemes, laughter, accent, and speaker gender—are causally linked to speech output and can be precisely steered to modify synthesis behavior without retraining.
AINeutralarXiv – CS AI · Jun 96/10
🧠Researchers introduce BareWave, a waveform-native text-to-speech system using flow-matching that eliminates intermediate acoustic representations and separate decoding stages. The framework addresses three key training challenges—lack of representational scaffolding, noise schedule optimization, and perceptual objective alignment—while maintaining inference without pretrained components, demonstrating competitive results in zero-shot voice cloning.
AIBullisharXiv – CS AI · Jun 16/10
🧠Researchers introduce Chatterbox-Flash, a zero-shot text-to-speech model combining block-diffusion decoding with streaming capabilities. The system addresses token distribution bias through prior-calibrated scoring and early-decoding schedules, achieving high-fidelity speech synthesis with low latency comparable to autoregressive systems.
