#fairness-evaluation News & Analysis

2 articles tagged with #fairness-evaluation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 197/10

🧠

DeFrame: Debiasing Large Language Models Against Framing Effects

Researchers identify 'framing disparity' as a hidden source of bias in large language models, where semantically equivalent prompts expressed differently produce inconsistent fairness outcomes. The study proposes DeFrame, a debiasing method that improves LLM consistency across alternative framings, addressing a gap between standard fairness evaluations and real-world performance.

🏢 Meta

AINeutralarXiv – CS AI · May 46/10

🧠

Bring Your Own Prompts: Use-Case-Specific Bias and Fairness Evaluation for LLMs

Researchers present a decision framework and open-source library (langfair) for evaluating bias and fairness risks in Large Language Models across specific deployment contexts. The study demonstrates that fairness evaluation cannot rely on benchmark performance alone, as risks vary substantially depending on use case, prompt characteristics, and stakeholder priorities.