AIBearisharXiv – CS AI · Jun 97/10
🧠
VESTA: A Fully Automated Scenario Generation and Safety Evaluation Framework for LLM Agents
Researchers introduce VESTA, an automated safety evaluation framework for LLM agents that generates 1,072 diverse evaluation scenarios across five risk dimensions. Testing 12 LLM agents reveals significant behavioral safety vulnerabilities, with average attack success rates of 47.1% and some models exceeding 70%, highlighting critical gaps in agent safety assurance.