#skill-retrieval News & Analysis

3 articles tagged with #skill-retrieval. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AINeutralarXiv – CS AI · May 97/10

🧠

SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents

Researchers introduce SkillRet, a large-scale benchmark dataset containing 17,810 public agent skills designed to evaluate how language model agents retrieve appropriate tools from massive skill libraries. The benchmark demonstrates that current retrieval methods struggle significantly with realistic large-scale deployments, though task-specific fine-tuning improves performance by up to 16.9 points on key metrics.

AINeutralarXiv – CS AI · Jun 106/10

🧠

SkillResolve-Bench: Measuring and Resolving Same-Capability Ambiguity in Agent Skill Retrieval

Researchers introduce SkillResolve-Bench, a benchmark for evaluating agent skill retrieval systems that addresses the critical problem of selecting the correct skill variant when multiple capabilities are semantically similar. The benchmark includes 661 helper/risky skill pairs and proposes SkillResolve, a method that achieves safer procedural exposure by selecting appropriate skill representatives from capability families.

AIBullisharXiv – CS AI · May 116/10

🧠

Group of Skills: Group-Structured Skill Retrieval for Agent Skill Libraries

Researchers introduce Group of Skills (GoSkills), a new method for organizing and retrieving skills in AI agent libraries that presents skills as structured execution contexts rather than flat lists. The approach improves agent performance on benchmark tasks while maintaining efficiency and doesn't require changes to existing agent systems.