#audio-encoding News & Analysis

2 articles tagged with #audio-encoding. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · Jun 106/10

🧠

Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding

Researchers introduce Spatial-Omni, a method that integrates First-Order Ambisonics (FOA) spatial audio into multimodal large language models, enabling them to understand sound localization and spatial scene reasoning. The approach includes new datasets and benchmarks with 400K audio clips and 2.1M QA pairs, demonstrating improved performance on spatial audio tasks while maintaining general audio understanding.

AIBullisharXiv – CS AI · May 76/10

🧠

JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructions

Researchers introduce JASTIN, an instruction-driven framework that combines frozen audio encoders with fine-tuned LLMs to evaluate generative audio models with zero-shot capabilities. The approach achieves state-of-the-art correlation with human ratings across speech, sound, and music evaluation tasks without task-specific retraining.