AIBearisharXiv – CS AI · 3h ago6/10
🧠
Modeling Community Attitude through Reaction Tone: A Human-AI Collaborative Framework for Evaluating LLM Alignment with Linguistic Behaviors in Online Communities
Researchers introduce CARE, a framework that evaluates how well large language models can simulate authentic community discourse by analyzing reaction tones to real-world events. The study reveals a persistent "realism gap" where explicit community prompts fail to meaningfully improve LLM simulation fidelity, highlighting that current alignment strategies are insufficient for capturing genuine sociolinguistic dynamics.