AIBullisharXiv – CS AI · Jun 37/10
🧠
The Shadow Price of Reasoning: Economic Perspective on Optimal Budget Allocation for LLMs
Researchers propose CLEAR, an economic optimization framework for allocating computational budgets during LLM inference by modeling resource allocation as a constrained optimization problem. The approach uses a global shadow price mechanism to redistribute tokens from queries unlikely to succeed to those near performance thresholds, achieving up to 3x accuracy improvements in resource-constrained environments.