AINeutralarXiv – CS AI · 7h ago6/10
🧠
When Softmax Fails at the Top: Extreme Value Corrections for InfoNCE
Researchers propose WEINCE, a modification to InfoNCE contrastive learning that corrects statistical misalignments in how softmax selects top-scoring examples using extreme value theory. The method adds anchor-wise batch statistics without trainable parameters and demonstrates consistent improvements across vision benchmarks.