y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#bias-in-ai News & Analysis

3 articles tagged with #bias-in-ai. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles
AIBearisharXiv – CS AI · Jun 97/10
🧠

Safety is Contextual, LLM-Judges Are Not: Navigating the Rigid Priors of Evaluators

A new research paper reveals that LLM-based safety judges—widely used to evaluate AI safety at scale—have significant blind spots: they struggle to adapt their evaluations when presented with new contextual information or alternative safety definitions that conflict with their internal priors. This limitation undermines confidence in current safety evaluation methodologies across the AI industry.

AIBearisharXiv – CS AI · Apr 107/10
🧠

Digital Skin, Digital Bias: Uncovering Tone-Based Biases in LLMs and Emoji Embeddings

Researchers conducted the first large-scale study comparing bias in skin-toned emoji representations across specialized emoji models and four major LLMs (Llama, Gemma, Qwen, Mistral), finding that while LLMs handle skin tone modifiers well, popular emoji embedding models exhibit severe deficiencies and systemic biases in sentiment and meaning across different skin tones.

🧠 Llama