AINeutralarXiv – CS AI · Jun 47/10
🧠
AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safety
Researchers introduce AICompanionBench, the first public benchmark dataset for evaluating AI safety in companion platforms like Replika and Character.AI, containing 2,123 annotated conversations across nine risk categories. Testing 20 state-of-the-art LLMs reveals that while models detect explicit harmful content effectively, they struggle significantly with subtle forms of harm like manipulation and frequently misclassify benign conversations.