AINeutralarXiv – CS AI · 15h ago6/10
🧠
Lost in Sampling: Assessing Lexical Reachability in LLMs via the Word Coverage Score (WCS)
Researchers introduce the Word Coverage Score (WCS), a metric revealing how standard LLM sampling filters (Top-p, Top-k, Min-p) mathematically suppress contextually appropriate vocabulary choices, rendering linguistically valid words unreachable despite existing in the probability space. The study demonstrates that industry-standard decoding defaults unintentionally homogenize text output, acting as hidden censorship mechanisms that limit lexical diversity in generated content.