8 articles tagged with #audio-generation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers have developed a new method called Latent-Control Heads (LatCHs) that enables efficient control of audio generation in diffusion models with significantly reduced computational costs. The approach operates directly in latent space, avoiding expensive decoder steps and requiring only 7M parameters and 4 hours of training while maintaining audio quality.
OpenAI has released Sora 2, an advanced video and audio generation model that significantly improves upon its predecessor. The new model features enhanced physics accuracy, sharper realism, synchronized audio capabilities, better user control, and expanded stylistic options.
Researchers introduce AG-REPA, a new method for improving audio generation models by strategically selecting which neural network layers to align with teacher models. The approach identifies that layers storing the most information aren't necessarily the most important for generation, leading to better performance in speech and audio synthesis.
Diffusion models have made significant breakthroughs in generating images, audio, and video content. However, these models face a key limitation in their reliance on iterative sampling processes, which results in slower generation speeds.
OpenAI shares insights from a limited preview of Voice Engine, their model for creating synthetic custom voices. The company is exploring the technology's potential while addressing associated challenges and risks.
A new neural network called Jukebox has been introduced that can generate music and rudimentary singing as raw audio across various genres and artist styles. The developers are releasing the model weights, code, and exploration tools to the public.
Researchers developed a two-stage prompt selection strategy for zero-shot text-to-speech synthesis that improves emotional intensity and speaker consistency. The method evaluates prompts using prosodic features, audio quality, and text-emotion coherence in a static stage, then uses textual similarity for dynamic prompt selection during synthesis.
The article announces AudioLDM 2 with improved speed performance. However, the article body appears to be empty or incomplete, limiting detailed analysis of the technical improvements or implications.
