#implicit-bias News & Analysis

4 articles tagged with #implicit-bias. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles

AINeutralarXiv – CS AI · Apr 107/10

🧠

Invisible Influences: Investigating Implicit Intersectional Biases through Persona Engineering in Large Language Models

Researchers introduced BADx, a novel metric that measures how Large Language Models amplify implicit biases when adopting different social personas, revealing that popular LLMs like GPT-4o and DeepSeek-R1 exhibit significant context-dependent bias shifts. The study across five state-of-the-art models demonstrates that static bias testing methods fail to capture dynamic bias amplification, with implications for AI safety and responsible deployment.

🧠 GPT-4🧠 Claude

AINeutralarXiv – CS AI · Mar 57/10

🧠

Implicit Bias of Per-sample Adam on Separable Data: Departure from the Full-batch Regime

New research reveals that per-sample Adam optimizer's implicit bias differs significantly from full-batch Adam in machine learning training. The study shows incremental Adam can converge to different solutions than expected, potentially impacting AI model optimization strategies.

AINeutralarXiv – CS AI · May 116/10

🧠

The Effect of Mini-Batch Noise on the Implicit Bias of Adam

Researchers present a theoretical framework showing how mini-batch noise in Adam optimizer training affects the implicit bias toward sharper or flatter loss landscape regions, finding that optimal momentum hyperparameters shift based on batch size—small batches favor the default (0.9, 0.999) settings while larger batches benefit from closer β₁ and β₂ values.

AINeutralarXiv – CS AI · Mar 54/10

🧠

Implicit Bias of the JKO Scheme

Researchers analyzed the implicit bias of the Jordan-Kinderlehrer-Otto (JKO) scheme, a time-discretization method for Wasserstein gradient flow used in optimizing energy functionals over probability measures. They found that the JKO scheme adds a deceleration term at second order that corresponds to canonical implicit biases like Fisher information for entropy and kinetic energy for Riemannian gradient descent.