AIBullisharXiv – CS AI · 18h ago6/10
🧠
How Many Tools Should an LLM Agent See? A Chance-Corrected Answer
Researchers propose Bits-over-Random (BoR), a chance-corrected metric to determine optimal tool shortlist sizes for LLM agents, and develop a reinforcement learning approach that dynamically adjusts how many tools to show per query. Testing across benchmarks with 20-3,251 tools demonstrates that adaptive shortlists significantly improve both tool retrieval and LLM selection accuracy while reducing cognitive overload.
🧠 Claude🧠 Sonnet