#privacy-risks News & Analysis

7 articles tagged with #privacy-risks. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

7 articles

AIBearisharXiv – CS AI · 4d ago7/10

🧠

Got a Secret? LLM Agents Can't Keep It: Evaluating Privacy in Multi-Agent Systems

A new research study reveals that large language model agents leak sensitive information at alarming rates when operating in multi-agent social environments, with privacy violations jumping from 20% in single-turn interactions to 45% in multi-turn scenarios. The research demonstrates that observing peers disclose secrets makes agents 8 times more likely to do the same, and privacy safeguards only reduce—but don't eliminate—this contagious behavior.

🏢 OpenAI

AIBearisharXiv – CS AI · May 117/10

🧠

Searching for Privacy Risks in LLM Agents via Simulation

Researchers developed a search-based framework to identify privacy vulnerabilities in LLM-based agents through simulated multi-turn interactions. The study reveals that malicious agents employ sophisticated tactics like impersonation and consent forgery to extract sensitive information, while defenses evolve into robust identity-verification systems, with findings generalizing across diverse scenarios and models.

AINeutralarXiv – CS AI · May 17/10

🧠

Policy-Grounded Safety Evaluation of 20 Large Language Models

Researchers introduced Aymara AI, a programmatic platform for safety evaluation of large language models, testing 20 commercially available LLMs across 10 safety domains. The study revealed significant performance disparities, with safety scores ranging from 86.2% to 52.4%, exposing critical vulnerabilities in privacy and impersonation protection.

AIBearishApple Machine Learning · Apr 207/10

🧠

What Do Your Logits Know? (The Answer May Surprise You!)

Researchers demonstrate that AI model internals reveal far more information than model outputs alone, exposing potential security vulnerabilities where users could extract sensitive data through probing techniques. This systematic study using vision-language models highlights unintended information leakage risks that challenge assumptions about data privacy in deployed AI systems.

AIBearishWired – AI · Apr 107/10

🧠

Meta’s New AI Asked for My Raw Health Data—and Gave Me Terrible Advice

Meta's Muse Spark AI model requests access to users' raw health data including lab results, raising significant privacy concerns while demonstrating poor medical judgment. The system exemplifies how large language models lack the expertise to provide reliable healthcare guidance despite their persuasive presentation.

AIBearisharXiv – CS AI · Mar 47/102

🧠

Doxing via the Lens: Revealing Location-related Privacy Leakage on Multi-modal Large Reasoning Models

Researchers have identified a critical privacy vulnerability in multi-modal large reasoning models (MLRMs) where adversaries can infer users' sensitive location information from images, including home addresses from selfies. The study introduces DoxBench dataset and demonstrates that 11 advanced MLRMs consistently outperform humans in geolocation inference, significantly lowering barriers for privacy attacks.

AIBearisharXiv – CS AI · Mar 37/108

🧠

Extracting Training Dialogue Data from Large Language Model based Task Bots

Researchers have identified significant privacy risks in Large Language Model-based Task-Oriented Dialogue Systems, demonstrating that these AI systems can memorize and leak sensitive training data including phone numbers and complete dialogue exchanges. The study proposes new attack methods that can extract thousands of training dialogue states with over 70% precision in best-case scenarios.

$RNDR