AINeutralarXiv – CS AI · 14h ago6/10
🧠
A comparative study of transformer-based embeddings for topic coherence
A research study comparing seven transformer-based language models of varying sizes (22M to 13B parameters) in topic modeling tasks found that model size has negligible impact on topic quality. This suggests smaller, more efficient models can match larger models' performance for topic coherence applications, potentially reducing computational costs without sacrificing output quality.