AINeutralarXiv – CS AI · 14h ago6/10
🧠
Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning
Researchers argue that text embedding models should prioritize implicit semantics and contextual meaning rather than surface-level similarity. A pilot study demonstrates that state-of-the-art embeddings barely outperform simple baselines on tasks requiring interpretive reasoning, stance recognition, and social understanding, suggesting a fundamental gap in how modern NLP systems are trained and evaluated.