y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#fairness News & Analysis

32 articles tagged with #fairness. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

32 articles
AIBearisharXiv – CS AI · May 127/10
🧠

Weight Pruning Amplifies Bias: A Multi-Method Study of Compressed LLMs for Edge AI

A comprehensive empirical study reveals that weight pruning—a technique for compressing large language models for edge devices—paradoxically amplifies bias while preserving performance metrics. The research shows activation-aware pruning methods maintain perplexity but increase stereotype reliance by up to 84%, suggesting current evaluation methods fail to detect fairness degradation in compressed models.

🏢 Perplexity
AIBearisharXiv – CS AI · May 117/10
🧠

Quality-Conditioned Agreement in Automated Short Answer Scoring: Mid-Range Degradation and the Impact of Task-Specific Adaptation

Research reveals that AI models, particularly few-shot large language models, struggle significantly with mid-range quality responses in automated short answer scoring, while fine-tuned models and human experts maintain consistent performance across all quality levels. This degradation raises fairness concerns for students with developing understanding, emphasizing the need for quality-conditioned evaluation metrics.

🧠 GPT-4🧠 GPT-5🧠 Claude
AIBearisharXiv – CS AI · Apr 147/10
🧠

Cross-Cultural Value Awareness in Large Vision-Language Models

Researchers have conducted a comprehensive study examining how large vision-language models (LVLMs) exhibit cultural stereotypes and biases when making judgments about people's moral, ethical, and political values based on cultural context cues in images. Using counterfactual image sets and Moral Foundations Theory, the analysis across five popular LVLMs reveals significant concerns about AI fairness beyond traditional social biases, with implications for deployed AI systems used globally.

AIBearisharXiv – CS AI · Apr 147/10
🧠

Demographic and Linguistic Bias Evaluation in Omnimodal Language Models

Researchers evaluated four omnimodal AI models across text, image, audio, and video processing, finding substantial demographic and linguistic biases particularly in audio understanding tasks. The study reveals significant accuracy disparities across age, gender, language, and skin tone, with audio tasks showing prediction collapse toward narrow categories, highlighting fairness concerns as these models see wider real-world deployment.

AIBearisharXiv – CS AI · Apr 147/10
🧠

Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text

Researchers systematically analyzed how leading LLMs (GPT-4o, Llama-3.3, Mistral-Large-2.1) generate demographically targeted messaging and found consistent gender and age-based biases, with male and youth-targeted messages emphasizing agency while female and senior-targeted messages stress tradition and care. The study demonstrates how demographic stereotypes intensify in realistic targeting scenarios, highlighting critical fairness concerns for AI-driven personalized communication.

🧠 GPT-4🧠 Llama
AIBearisharXiv – CS AI · Mar 177/10
🧠

Widespread Gender and Pronoun Bias in Moral Judgments Across LLMs

A comprehensive study of six major LLM families reveals systematic biases in moral judgments based on gender pronouns and grammatical markers. The research found that AI models consistently favor non-binary subjects while penalizing male subjects in fairness assessments, raising concerns about embedded biases in AI ethical decision-making.

🏢 Meta🧠 Grok
AIBullisharXiv – CS AI · Mar 177/10
🧠

Justitia: Fair and Efficient Scheduling of Task-parallel LLM Agents with Selective Pampering

Justitia is a new scheduling system for task-parallel LLM agents that optimizes GPU server performance through selective resource allocation based on completion order prediction. The system uses memory-centric cost quantification and virtual-time fair queuing to achieve both efficiency and fairness in LLM serving environments.

🏢 Meta
AINeutralarXiv – CS AI · Mar 127/10
🧠

Assessing Cognitive Biases in LLMs for Judicial Decision Support: Virtuous Victim and Halo Effects

Research examining five major LLMs found they exhibit human-like cognitive biases when evaluating judicial scenarios, showing stronger virtuous victim effects but reduced credential-based halo effects compared to humans. The study suggests LLMs may offer modest improvements over human decision-making in judicial contexts, though variability across models limits current practical application.

🧠 ChatGPT🧠 Claude🧠 Sonnet
AINeutralarXiv – CS AI · Mar 57/10
🧠

A Systematic Analysis of Biases in Large Language Models

A comprehensive study analyzed four major large language models (LLMs) across political, ideological, alliance, language, and gender dimensions, revealing persistent biases despite efforts to make them neutral. The research used various experimental methods including news summarization, stance classification, UN voting patterns, multilingual tasks, and survey responses to uncover these systematic biases.

AIBearishDecrypt – AI · 4d ago6/10
🧠

AI Chatbots Show Bias Toward Catholicism, Researchers Say

Researchers have identified systematic bias in AI chatbots that steer users toward Catholicism while steering them away from religions like Jehovah's Witnesses. This finding raises concerns about the neutrality and fairness of widely-used AI systems in handling sensitive topics like religion.

AI Chatbots Show Bias Toward Catholicism, Researchers Say
AINeutralarXiv – CS AI · May 96/10
🧠

CrossCult-KIBench: A Benchmark for Cross-Cultural Knowledge Insertion in MLLMs

Researchers introduce CrossCult-KIBench, a benchmark dataset for evaluating how multimodal large language models (MLLMs) handle cross-cultural knowledge insertion across English, Chinese, and Arabic contexts. The work reveals that current AI models struggle to adapt to specific cultural contexts without degrading performance in other cultures, establishing a new research direction for culturally-aware AI systems.

AINeutralarXiv – CS AI · May 16/10
🧠

People-Centred Medical Image Analysis

Researchers propose PecMan, a human-AI framework designed to optimize fairness, accuracy, and clinical workflow integration simultaneously in medical image analysis. The framework addresses the gap between high-performing AI diagnostic systems and their limited real-world adoption by balancing performance across diverse patient populations while respecting clinician workload constraints.

🏢 Meta
AINeutralarXiv – CS AI · May 16/10
🧠

Automatic Causal Fairness Analysis with LLM-Generated Reporting

Researchers introduce FairMind, an automated tool that detects fairness bias in machine learning datasets using causal analysis and LLM-generated reports. The software applies the standard fairness model to evaluate how protected variables influence predictions through counterfactual reasoning, addressing a critical gap in existing AutoML frameworks that typically ignore fairness considerations.

AINeutralarXiv – CS AI · Apr 146/10
🧠

Fairness is Not Flat: Geometric Phase Transitions Against Shortcut Learning

Researchers propose a geometric methodology using a Topological Auditor to detect and eliminate shortcut learning in deep neural networks, forcing models to learn fair representations. The approach reduces demographic bias vulnerabilities from 21.18% to 7.66% while operating more efficiently than existing post-hoc debiasing techniques.

AINeutralarXiv – CS AI · Apr 136/10
🧠

Mitigating Extrinsic Gender Bias for Bangla Classification Tasks

Researchers have developed RandSymKL, a debiasing technique for Bangla language models that mitigates gender bias in classification tasks like sentiment analysis and hate speech detection. The study introduces four manually annotated benchmark datasets with gender-perturbation testing and demonstrates that the approach effectively reduces bias while maintaining competitive accuracy compared to existing methods.

AIBullisharXiv – CS AI · Apr 76/10
🧠

APPA: Adaptive Preference Pluralistic Alignment for Fair Federated RLHF of LLMs

Researchers propose APPA, a new framework for aligning large language models with diverse human preferences in federated learning environments. The method dynamically reweights group-level rewards to improve fairness, achieving up to 28% better alignment for underperforming groups while maintaining overall model performance.

🏢 Meta🧠 Llama
AIBearisharXiv – CS AI · Mar 266/10
🧠

Who Benefits from RAG? The Role of Exposure, Utility and Attribution Bias

Research reveals that Retrieval-Augmented Generation (RAG) systems exhibit fairness issues, with queries from certain demographic groups systematically receiving higher accuracy than others. The study identifies three key factors affecting fairness: group exposure in retrieved documents, utility of group-specific documents, and attribution bias in how generators use different group documents.

🏢 Meta
AINeutralarXiv – CS AI · Mar 176/10
🧠

MESD: Detecting and Mitigating Procedural Bias in Intersectional Groups

Researchers propose MESD (Multi-category Explanation Stability Disparity), a new metric to detect procedural bias in AI models across intersectional groups. They also introduce UEF framework that balances utility, explanation quality, and fairness in machine learning systems.

AINeutralarXiv – CS AI · Mar 176/10
🧠

Evaluation of Audio Language Models for Fairness, Safety, and Security

Researchers introduce a structural taxonomy and unified evaluation framework for Audio Large Language Models (ALLMs) to assess fairness, safety, and security. The study reveals systematic differences in how ALLMs handle audio versus text inputs, with FSS behavior closely tied to acoustic information integration methods.

AIBullisharXiv – CS AI · Mar 176/10
🧠

Ethical Fairness without Demographics in Human-Centered AI

Researchers introduce Flare, a new AI fairness framework that ensures ethical outcomes without requiring demographic data, addressing privacy and regulatory concerns in human-centered AI applications. The system uses Fisher Information to detect hidden biases and includes a novel evaluation metric suite called BHE for measuring ethical fairness beyond traditional statistical measures.

🏢 Meta
AINeutralarXiv – CS AI · Mar 166/10
🧠

Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Models

Researchers propose integrating causal methods into machine learning systems to balance competing objectives like fairness, privacy, robustness, accuracy, and explainability. The paper argues that addressing these principles in isolation leads to conflicts and suboptimal solutions, while causal approaches can help navigate trade-offs in both trustworthy ML and foundation models.

AINeutralarXiv – CS AI · Mar 26/1019
🧠

BRIDGE the Gap: Mitigating Bias Amplification in Automated Scoring of English Language Learners via Inter-group Data Augmentation

Researchers developed BRIDGE, a framework to reduce bias in AI-powered automated scoring systems that unfairly penalize English Language Learners (ELLs). The system addresses representation bias by generating synthetic high-scoring ELL samples, achieving fairness improvements comparable to using additional human data while maintaining overall performance.

AINeutralarXiv – CS AI · Mar 26/1017
🧠

When Does Multimodal Learning Help in Healthcare? A Benchmark on EHR and Chest X-Ray Fusion

Researchers conducted a systematic benchmark study on multimodal fusion between Electronic Health Records (EHR) and chest X-rays for clinical decision support, revealing when and how combining data modalities improves healthcare AI performance. The study found that multimodal fusion helps when data is complete but benefits degrade under realistic missing data scenarios, and released an open-source benchmarking toolkit for reproducible evaluation.

AINeutralarXiv – CS AI · Mar 27/1019
🧠

Biases in the Blind Spot: Detecting What LLMs Fail to Mention

Researchers have developed an automated pipeline to detect hidden biases in Large Language Models that don't appear in their reasoning explanations. The system discovered previously unknown biases like Spanish fluency and writing formality across seven LLMs in hiring, loan approval, and university admission tasks.

Page 1 of 2Next →