AIBearisharXiv – CS AI · 15h ago7/10
🧠
Elias in the Lighthouse, Again? Diagnosing Low Diversity in LLM Stories
Researchers found that LLM-generated stories suffer from severe lack of diversity, with just 11 specific words appearing in 88.3% of outputs across multiple models. These recurring elements—character names like Elias and Mara, settings like lighthouses, and professions like clockmaker—originate from preference data used in model alignment rather than training data, revealing how small datasets can disproportionately shape AI outputs.