y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#music-generation News & Analysis

23 articles tagged with #music-generation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

23 articles
AIBullisharXiv – CS AI · Jun 97/10
🧠

Audio-FLAN: An Instruction-Following Dataset for Unified Audio Understanding and Generation of Speech, Music, and Sound

Researchers introduce Audio-FLAN, a large-scale instruction-tuning dataset with over 100 million instances covering 80 diverse tasks across speech, music, and sound domains. This dataset addresses a critical gap in unified audio-language models by enabling both audio understanding and generation tasks, advancing the integration of audio capabilities into large language models.

🏢 Hugging Face
AIBearisharXiv – CS AI · Jun 17/10
🧠

Mental Damage: Caption Poisoning Attacks on Retrieval-Augmented Text-to-Music Generation

Researchers demonstrate a novel poisoning attack on retrieval-augmented text-to-music systems where attackers inject malicious captions into music databases to manipulate generation outputs toward attacker-chosen targets while maintaining alignment with original user prompts. The attack reveals a critical integrity vulnerability in AI systems that depend on external knowledge bases for prompt augmentation.

AIBearisharXiv – CS AI · Feb 277/107
🧠

Bob's Confetti: Phonetic Memorization Attacks in Music and Video Generation

Researchers discovered a vulnerability in AI music and video generation systems where phonetic prompts can bypass copyright filters. The 'Adversarial PhoneTic Prompting' attack achieves 91% similarity to copyrighted content by using sound-alike phrases that preserve acoustic patterns while evading text-based detection.

$NEAR$APT
AINeutralarXiv – CS AI · Jun 256/10
🧠

Attractive and Repulsive Pattern Control in Sequence Generation

Researchers introduce a signed pattern control mechanism for variable-order Markov sequence generation that reduces unwanted repetition and controls text generation quality through weighted recurrence automata and belief propagation sampling. Testing on musical sequences from Bach, Telemann, and jazz databases demonstrates the method effectively decreases self-reuse while maintaining coherence and training data fidelity.

AINeutralarXiv – CS AI · Jun 236/10
🧠

LK Jam: System Architecture and Implementation of a Real-Time Human-AI Interactive Music Generation System using Role-Aware GRU

LK_Jam is a real-time human-AI music generation system that uses lightweight GRU neural networks and optimized C++ engineering to enable low-latency, bidirectional musical interaction between humans and AI performers. The system achieves O(1) complexity inference through lock-free architecture and sparse event streaming, addressing a significant technical challenge in live music applications.

AINeutralarXiv – CS AI · Jun 236/10
🧠

Libretto: Giving LLM Agents a Sense of Musical Structure

Researchers introduce Libretto, an LLM-native framework that enables AI agents to generate and edit symbolic music with explicit structural control over rhythm, harmony, melody, and form. The system transforms music generation from opaque audio outputs into inspectable, measurable objects that support iterative refinement and educational applications.

AINeutralarXiv – CS AI · Jun 196/10
🧠

Co-policy: Responsive Human-Robot Co-Creation for Musical Performances

Researchers introduce Co-policy, a framework enabling robots to participate in real-time musical co-creation with humans by combining semantic understanding with physically executable performance. The system uses a fine-tuned vision-language model and a Gaussian-Mixture Visuomotor Policy to generate complementary musical responses rather than merely reproducing user input, demonstrating improved performance over existing diffusion-policy approaches.

AINeutralarXiv – CS AI · Jun 86/10
🧠

Towards Unified Song Generation and Singing Voice Conversion with Accompaniment Co-Generation

Researchers introduce UniSinger, an AI framework that unifies song generation with singing voice conversion by enabling zero-shot speaker cloning and accompaniment co-generation. The system uses a multimodal diffusion transformer with curriculum learning to simultaneously handle vocal timbre control and musical accompaniment, advancing generative music production capabilities.

AINeutralarXiv – CS AI · Jun 56/10
🧠

Exploring LLMs for South Asian Music Understanding and Generation

Researchers conducted the first systematic evaluation of Large Language Models on South Asian classical music understanding and generation, finding that frontier models like Gemini 2.5 Pro achieve 85-90% accuracy on music comprehension but struggle with stylistically faithful generation (40% success rate). The study reveals that current LLMs handle Western musical traditions far better than structurally distinct, low-resource traditions like Hindustani and Bengali classical music.

🧠 Gemini
AINeutralarXiv – CS AI · Jun 26/10
🧠

HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark

Researchers introduce HAIM, a new dataset and benchmark for detecting AI integration across music production workflows, moving beyond binary AI-or-human classification to track granular stages of AI intervention including hybrid and mastered content. The work exposes critical limitations in current AI detection systems as generative music platforms like Suno and Udio achieve human-quality output.

AINeutralarXiv – CS AI · Jun 16/10
🧠

Latent Space Disentanglement via Activation Steering for Interpretable Attribute Control in Symbolic Music Generation

Researchers propose a novel framework for controlling symbolic music generation in Transformer models through activation steering, enabling fine-grained control over musical attributes like pitch and duration without retraining. The approach uses latent space analysis and orthogonalization techniques to independently manipulate multiple attributes while reducing interference and maintaining generation quality.

AINeutralDecrypt – AI · May 276/10
🧠

ElevenLabs, Stability AI Drop New AI Music Models—Can They Catch Suno?

ElevenLabs and Stability AI have released new AI music generation models—Music v2 and Stable Audio 3.0 respectively—featuring advanced composition tools and longer track generation. Both companies are positioning themselves to compete with market leader Suno, though their competitive advantage remains unclear.

ElevenLabs, Stability AI Drop New AI Music Models—Can They Catch Suno?
🏢 Stability
AINeutralarXiv – CS AI · May 276/10
🧠

Genre Controlled Music Generation via Activation Steering

Researchers present a novel method for controlling music generation in the MusicGen transformer by using activation steering techniques applied at inference time. The approach enables precise genre control through linear probes that manipulate the model's residual stream, demonstrating how interpretable AI behaviors can enhance collaborative music creation.

AIBearishThe Verge – AI · Apr 56/10
🧠

Suno is a music copyright nightmare

AI music platform Suno's copyright filters can be easily bypassed with minimal effort, allowing users to generate AI imitations of popular songs from artists like Beyoncé, Black Sabbath, and Aqua. Despite Suno's policy prohibiting copyrighted material use, the platform's detection system proves inadequate at preventing copyright infringement.

Suno is a music copyright nightmare
AIBullishGoogle DeepMind Blog · Feb 186/106
🧠

A new way to express yourself: Gemini can now create music

Google's Gemini app has integrated Lyria 3, its most advanced music generation model, allowing users to create 30-second music tracks from text or image inputs. This feature democratizes music creation by making AI-powered composition accessible to anyone through the Gemini interface.

AINeutralOpenAI News · Apr 306/104
🧠

Jukebox

A new neural network called Jukebox has been introduced that can generate music and rudimentary singing as raw audio across various genres and artist styles. The developers are releasing the model weights, code, and exploration tools to the public.

AIBullishOpenAI News · Apr 256/106
🧠

MuseNet

OpenAI has created MuseNet, a deep neural network capable of generating 4-minute musical compositions using 10 different instruments and combining various musical styles from country to classical to rock. The system uses the same transformer technology as GPT-2, learning musical patterns through unsupervised training on hundreds of thousands of MIDI files rather than explicit musical programming.

AINeutralThe Verge – AI · Mar 255/10
🧠

Google Lyria 3 Pro makes longer AI songs

Google has released Lyria 3 Pro, an upgraded AI music generation tool that can create tracks up to three minutes long, six times longer than the previous 30-second limit. The tool allows users to prompt for specific song elements like intros, choruses, and bridges, and can generate both music and lyrics from text prompts or reference photos.

Google Lyria 3 Pro makes longer AI songs
AIBullisharXiv – CS AI · Mar 35/105
🧠

Efficient Long-Sequence Diffusion Modeling for Symbolic Music Generation

Researchers developed SMDIM, a new diffusion model for symbolic music generation that efficiently handles long sequences by combining global structure construction with local refinement. The model outperforms existing approaches in both generation quality and computational efficiency across various musical styles including Western classical, popular, and folk music.

$NEAR
AIBullisharXiv – CS AI · Mar 34/104
🧠

Depth-Structured Music Recurrence: Budgeted Recurrent Attention for Full-Piece Symbolic Music Modeling

Researchers introduce Depth-Structured Music Recurrence (DSMR), a new AI training method for symbolic music generation that processes complete compositions efficiently. The technique uses stateful recurrent attention with distributed memory across layers, achieving similar performance to full-memory models while using 59% less GPU memory and 36% higher throughput.

AINeutralarXiv – CS AI · Mar 34/106
🧠

CMI-RewardBench: Evaluating Music Reward Models with Compositional Multimodal Instruction

Researchers introduce CMI-RewardBench, a comprehensive evaluation framework for music generation AI models that can process multimodal inputs including text, lyrics, and audio. The system includes a 110k sample preference dataset and reward models that show strong correlation with human judgments for music quality assessment.

AINeutralarXiv – CS AI · Mar 34/107
🧠

SyncTrack: Rhythmic Stability and Synchronization in Multi-Track Music Generation

Researchers introduce SyncTrack, an AI model for multi-track music generation that addresses rhythmic stability and synchronization issues in existing models. The model uses track-shared modules for common rhythm and track-specific modules for diverse timbres, introducing new metrics to evaluate multi-track music quality.