#prompt-attacks News & Analysis

2 articles tagged with #prompt-attacks. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 27/10

🧠

Defenses & Enablers For Skill Injection Attacks on Terminal Based Agents

Researchers demonstrate that LLM-based terminal agents face significant security risks from skill injection attacks, where malicious instructions embedded in reusable skill files can compromise system integrity. Guardian-based defenses—both static and dynamic intermediary agents—reduce attack success rates by over 50%, though dynamic guardians prove more robust against sophisticated attack reframing attempts.

AIBearisharXiv – CS AI · Mar 277/10

🧠

LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shifts

Researchers have identified a new vulnerability in large language models called 'natural distribution shifts' where seemingly benign prompts can bypass safety mechanisms to reveal harmful content. They developed ActorBreaker, a novel attack method that uses multi-turn prompts to gradually expose unsafe content, and proposed expanding safety training to address this vulnerability.