AINeutralarXiv – CS AI · 5h ago6/10
🧠
Online Pandora's Box for Contextual LLM Cascading
Researchers propose an online contextual Pandora's Box model for optimizing LLM API cascading, where decision-makers sequentially query multiple APIs and select outputs based on indirect reward feedback. The approach achieves theoretically optimal regret bounds without requiring full distribution estimation, advancing practical optimization strategies for multi-API LLM systems.
$MKR