When Numbers Tell Half the Story: Human-Metric Alignment in Topic Model Evaluation

Researchers introduce Topic Word Mixing (TWM), a new human evaluation method for assessing topic models in specialized domains. The study reveals misalignment between automated metrics and human judgment, particularly in domain-specific corpora like philosophy of science publications.