#speech-tokenization News & Analysis

3 articles tagged with #speech-tokenization. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AIBullisharXiv – CS AI · May 297/10

🧠

HoliTok:A Coutinuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding

HoliTok is a new continuous speech tokenization model that unifies speech generation and understanding tasks by encoding 48kHz audio into compact 128-dimensional latent sequences at 25Hz. The breakthrough addresses a key challenge in building unified speech foundation models by creating a tokenization space that balances reconstruction fidelity, semantic preservation, and learnability without requiring architectural workarounds.

AINeutralarXiv – CS AI · Jun 86/10

🧠

HybridCodec: Fast Dual-Stream, Semantically Enhanced Neural Audio Codec

HybridCodec presents a novel neural audio codec architecture that combines semantic and acoustic feature streams while distilling SSL representations, achieving 3x speedup over existing dual-stream models. The advancement addresses the growing demand for efficient audio tokenizers in multimodal large language models by improving semantic specialization and cross-lingual robustness.

AINeutralarXiv – CS AI · May 276/10

🧠

DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusion

Researchers introduce DSA-Tokenizer, a novel speech tokenization system that separates semantic content from acoustic style using distinct optimization paths and Flow Matching decoders. The approach enables discrete Speech LLMs to achieve better disentanglement while supporting efficient voice cloning and high-fidelity speech generation with minimal inference steps.