AIBullisharXiv – CS AI · 7h ago6/10
🧠
INFRAMIND: Infrastructure-Aware Multi-Agent Orchestration
INFRAMIND is a new framework that optimizes multi-agent LLM orchestration by making real-time infrastructure state (queue depths, cache pressure, latencies) central to routing and scheduling decisions. Using reinforcement learning, the system dynamically adjusts model selection and pipeline topology based on GPU cluster load, achieving up to 7.6% accuracy gains and 7x latency reduction while maintaining 99.9% SLO compliance under high load.