Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structures

Researchers investigated lower bounds for language modeling using semantic structures, finding that binary vector representations of semantic structure can be dramatically reduced in dimensionality while maintaining effectiveness. The study establishes that prediction quality bounds require analysis of signal-noise distributions rather than single scores alone.