AIBearisharXiv – CS AI · 6h ago7/10
🧠
IDP-Bench: Benchmarking ability of LLMs to protect personal information in interdependent privacy contexts
Researchers introduced IDP-Bench, the first benchmark evaluating how well large language models protect interdependent privacy—where one person's data can be revealed by others without consent. Testing eight open-source LLMs revealed strong performance in recognizing data co-ownership but significant weaknesses in understanding contextual integrity parameters and judging sharing appropriateness, with smaller models showing particular vulnerability to prompt sensitivity.