AINeutralarXiv – CS AI · 9h ago7/10
🧠
CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives
Researchers introduce CLASH, a dataset of 345 high-stakes dilemmas with 3,795 diverse perspectives, revealing that leading language models including GPT-4 and Claude struggle significantly with ambivalent value-based decisions. The study exposes fundamental limitations in LLM reasoning about conflicting values, with top models achieving only 24-51% accuracy on ambivalent scenarios, indicating a critical gap in AI systems designed for high-consequence decision-making.
🧠 GPT-5🧠 Claude