AINeutralarXiv – CS AI · Jun 26/10
🧠
When Softmax Fails at the Top: Extreme Value Corrections for InfoNCE
Researchers propose WEINCE, a modification to InfoNCE contrastive learning that corrects statistical misalignments in how softmax selects top-scoring examples using extreme value theory. The method adds anchor-wise batch statistics without trainable parameters and demonstrates consistent improvements across vision benchmarks.