AINeutralarXiv – CS AI · 6h ago7/10
🧠
SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents
Researchers introduce SkillRet, a large-scale benchmark dataset containing 17,810 public agent skills designed to evaluate how language model agents retrieve appropriate tools from massive skill libraries. The benchmark demonstrates that current retrieval methods struggle significantly with realistic large-scale deployments, though task-specific fine-tuning improves performance by up to 16.9 points on key metrics.