#sampling-diversity News & Analysis

2 articles tagged with #sampling-diversity. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 46/10

🧠

The Loss Is Not Enough: Sampling Conditions and Inductive Bias in Contrastive Representation Learning

Researchers develop a theoretical framework proving that contrastive learning—a dominant self-supervised AI technique—requires specific sampling diversity conditions to recover meaningful latent geometry. They demonstrate that standard approaches can learn non-orthogonal representations and propose a corrected InfoNCE variant, with experiments showing that architectural inductive bias becomes critical when sampling diversity is limited.

AIBullisharXiv – CS AI · Apr 146/10

🧠

The Past Is Not Past: Memory-Enhanced Dynamic Reward Shaping

Researchers introduce MEDS, a memory-enhanced reward shaping framework that addresses a critical reinforcement learning failure mode where language models repeatedly generate similar errors. By tracking historical behavioral patterns and penalizing recurring mistake clusters, the method achieves consistent performance improvements across multiple datasets and models while increasing sampling diversity.