AIBullisharXiv – CS AI · 18h ago6/10
🧠
Harmonia: End-to-End RAG Serving Optimization
Harmonia is a new end-to-end RAG serving framework that optimizes the deployment and runtime performance of Retrieval-Augmented Generation pipelines. The system achieves 2.04x throughput improvements and reduces SLO violations by up to 78.4% through intelligent pipeline composition, heterogeneity-aware deployment, and dynamic load management.