y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#algorithmic-fairness News & Analysis

23 articles tagged with #algorithmic-fairness. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

23 articles
AIBearisharXiv – CS AI · Jun 87/10
🧠

The Geography of Algorithmic Judgment: LLM Intermediaries, Place Identity, and Racial Steering in Housing Search

Researchers audited seven large language models across four U.S. cities and found that LLMs exhibit racial steering behaviors in housing recommendations, where the same preference produces different location suggestions depending on a user's perceived racial identity. The steering emerges dynamically from model interpretations rather than static biases, and varies significantly by city, suggesting that AI-mediated housing platforms may inadvertently perpetuate fair housing violations.

🏢 Meta
AIBearisharXiv – CS AI · Jun 27/10
🧠

Implicit Geographic Inference in LLM Medical Triage: Language-Driven Disparities in Emergency Recommendations

Researchers discovered that large language models produce dramatically different medical triage recommendations for identical symptoms based solely on the input language, with emergency room referral rates ranging from 0% to 30% across six languages despite consistent severity scores. The effect persists due to implicit geographic inference from language choice rather than translation quality, raising critical concerns about AI bias in healthcare systems.

🧠 Gemini
AINeutralarXiv – CS AI · Jun 27/10
🧠

Position: Beyond Sensitive Attributes, ML Fairness Should Quantify Structural Injustice via Social Determinants

A research position paper argues that algorithmic fairness frameworks should move beyond focusing on sensitive attributes like race and gender to examine structural injustice through social determinants—contextual variables that shape outcomes systemically. The authors demonstrate through college admissions models, census data analysis, and healthcare screening applications that fairness interventions centered solely on sensitive attributes can paradoxically create new forms of structural injustice.

AIBearisharXiv – CS AI · Jun 17/10
🧠

LLM Bias Evaluation: Gender, Racial, and Age Disparities in Occupational and Crime Scenarios

A comprehensive study of four leading 2024 LLMs reveals significant gender, racial, and age biases in occupational and crime scenario depictions, with deviations up to 54% from real-world data. The research identifies a critical 'debiasing paradox' where efforts to reduce certain biases inadvertently over-correct and exacerbate other disparities, highlighting fundamental limitations in current bias mitigation techniques.

🧠 GPT-4🧠 Claude🧠 Gemini
AINeutralarXiv – CS AI · May 47/10
🧠

Social Bias in LLM-Generated Code: Benchmark and Mitigation

Researchers have identified severe social bias in code generated by large language models, with bias scores reaching 60.58% across four major models. They propose a Fairness Monitor Agent that reduces bias by 65.1% while improving code correctness, revealing that standard fairness interventions often amplify rather than mitigate demographic discrimination in AI-generated software.

AINeutralarXiv – CS AI · Apr 147/10
🧠

Exploring the impact of fairness-aware criteria in AutoML

Researchers demonstrate that integrating fairness metrics directly into AutoML optimization improves algorithmic fairness by 14.5% while reducing data usage by 35.7%, though at the cost of a 9.4% decrease in predictive accuracy. This study challenges the industry standard of prioritizing performance over fairness and shows that simpler, fairer ML models can achieve practical balance without requiring complex architectures.

🏢 Meta
AINeutralarXiv – CS AI · Feb 277/107
🧠

Operationalizing Fairness: Post-Hoc Threshold Optimization Under Hard Resource Limits

Researchers developed a new framework for deploying AI systems in high-stakes environments that balances safety, fairness, and efficiency under strict resource constraints. The study found that capacity limits dominate ethical considerations, determining deployment thresholds in over 80% of tested scenarios while maintaining better performance than traditional fairness approaches.

$NEAR
AINeutralarXiv – CS AI · Jun 26/10
🧠

Demystifying the Optimal Fair Classifier in Multi-Class Classification

Researchers present a theoretical framework and practical algorithms for achieving fairness in multi-class machine learning classification tasks, addressing a gap where most bias mitigation techniques focus on binary settings. The work proposes both in-processing and post-processing methods that converge to an optimal accuracy-fairness Pareto frontier, with experimental validation across multiple datasets.

🏢 Meta
AINeutralarXiv – CS AI · Jun 26/10
🧠

COPF: An Online Framework for Deployment-Stable Counterfactual Fairness in Evolving Graphs

Researchers introduce COPF, a framework for monitoring and controlling fairness in online link recommendation systems on evolving graphs. The system addresses the challenge that recommendation algorithms are performative—they change user behavior and create feedback loops that make traditional fairness estimates unreliable after deployment.

AINeutralarXiv – CS AI · Jun 26/10
🧠

Avoiding Structural Failure Modes in Tabular Fair SSL: Online Primal-Dual Allocation under Confidence Gating

Researchers identify critical failure modes in semi-supervised learning (SSL) applied to tabular data with fairness constraints, where fairness regularizers can paradoxically erode model performance. They propose Online Primal-Dual Allocation (OPDA), an adaptive controller that dynamically balances fairness and stability penalties without manual tuning, demonstrating improved robustness across benchmark datasets like Adult, COMPAS, and ACSIncome.

🏢 Meta
AINeutralarXiv – CS AI · Jun 16/10
🧠

Extending the UXR Point of View Pyramid: A Generative AI-Augmented Methodology for Human-Centred AI Systems

Researchers have extended the UXR Point of View methodology to address AI-driven financial systems in debt management, creating an AI-augmented framework that embeds generative AI into user research workflows while maintaining human oversight and ethical accountability. The work responds to rising UK household debt and the opacity of algorithmic credit and repayment systems, positioning AI as a support tool rather than an autonomous decision-maker in high-stakes financial environments.

AINeutralarXiv – CS AI · May 295/10
🧠

Approximate Proportionality in Online Fair Division

Researchers resolve a gap in online fair division theory by proving that proportionality up to one good (PROP1) cannot be approximated by standard greedy algorithms against adaptive adversaries, but can be achieved through randomized allocation or learning-augmented approaches with predictions.

🏢 Meta
AINeutralarXiv – CS AI · May 296/10
🧠

Reducing Political Manipulation with Consistency Training

Researchers have identified systematic political bias in large language models and developed Political Consistency Training (PCT), a reinforcement learning method to mitigate covert political manipulation. The technique reduces asymmetric treatment of opposing political topics while maintaining overall model helpfulness.

AINeutralarXiv – CS AI · May 286/10
🧠

Cyberbullying Governance on Social Media: A Unified Framework from Content Identification to Intervention

Researchers propose a unified framework for cyberbullying governance on social media that moves beyond isolated content detection to integrated, continuous moderation across four interconnected stages: content identification, user behavior modeling, diffusion dynamics, and intervention strategies. The framework addresses critical gaps in existing approaches by accounting for user behavioral patterns, toxic event spread, and proactive mitigation rather than reactive detection alone.

AINeutralarXiv – CS AI · May 286/10
🧠

OccuReward: LLM-Guided Occupant-Centric Reward Shaping for Demographic Equity in Grid-Interactive Buildings

Researchers introduce OccuReward, an LLM-guided framework that shapes reward functions for AI-controlled building energy systems to promote demographic equity in occupant comfort. Testing with four occupant profiles reveals significant disparities in initial AI performance, with elderly female occupants experiencing lowest satisfaction, though targeted refinement achieved dramatic improvements (567% for elderly females) while reducing energy costs by 3.2%.

🧠 Gemini
AINeutralarXiv – CS AI · May 286/10
🧠

Whose Name Comes Up? III: Persona Prompting Effects in LLM-Based Scholar Recommendation

Researchers benchmarked 43 large language models used for academic scholar recommendations, revealing that prompt design significantly affects recommendation quality and diversity. The study found that model choice, persona prompting (language, location, role), and context variables independently shape which scholars are recommended, with geographic location prompts producing the most variation in factuality and representativeness across disciplines.

AINeutralarXiv – CS AI · May 275/10
🧠

AI-Driven Contribution Evaluation and Conflict Resolution: A Framework & Design for Group Workload Investigation

Researchers propose an AI-enhanced framework for evaluating individual contributions and resolving disputes in team environments by analyzing submissions, communications, and coordination records. The system uses LLMs to generate transparent advisory judgments based on normalized metrics across Contribution, Interaction, and Role dimensions, addressing a persistent gap in fair workload assessment.

AINeutralarXiv – CS AI · May 126/10
🧠

Fairness of Explanations in Artificial Intelligence (AI): A Unifying Framework, Axioms, and Future Direction toward Responsible AI

Researchers present a unified framework addressing a critical gap between algorithmic fairness and explainable AI (XAI): models can produce fair outputs while employing biased reasoning processes. The study introduces the concept of 'procedural bias' and proposes a conditional invariance framework to formalize and audit explanation fairness, establishing the first comprehensive taxonomy and evaluation workflow for this emerging field.

AINeutralarXiv – CS AI · May 126/10
🧠

The Pok\'emon Theorem and other Fairness Impossibility Results

Researchers demonstrate that multiple fairness impossibility results in machine learning share a common geometric structure rooted in RKHS theory, proving that fairness criteria become mathematically incompatible when base rates differ across groups. The work introduces the 'Pokémon theorem' showing any finite collection of linear fairness constraints leaves residual violations, with implications for fair AI systems in high-stakes applications.

🏢 Meta
AINeutralarXiv – CS AI · May 96/10
🧠

Tuning Derivatives for Causal Fairness in Machine Learning

Researchers introduce a new mathematical framework for detecting and mitigating algorithmic bias in machine learning systems by using path-specific derivatives to distinguish between legitimate and illegitimate causal pathways. The approach extends fairness concepts to continuous protected attributes like age, addressing limitations in existing methods that primarily handle categorical variables.

🏢 Meta
AINeutralarXiv – CS AI · May 16/10
🧠

MIFair: A Mutual-Information Framework for Intersectionality and Multiclass Fairness

Researchers introduce MIFair, a machine learning framework using mutual information to assess and mitigate bias in AI systems, with particular strength in handling intersectionality and multiclass classification. The framework consolidates diverse fairness metrics into a unified approach and demonstrates effectiveness on real-world datasets while maintaining predictive performance.

AINeutralarXiv – CS AI · Apr 106/10
🧠

CAFP: A Post-Processing Framework for Group Fairness via Counterfactual Model Averaging

Researchers introduce CAFP, a post-processing framework that mitigates algorithmic bias by averaging predictions across factual and counterfactual versions of inputs where sensitive attributes are flipped. The model-agnostic approach eliminates the need for retraining or architectural modifications, making fairness interventions practical for deployed systems in high-stakes domains like credit scoring and criminal justice.

🏢 Meta