#model-audit News & Analysis

3 articles tagged with #model-audit. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AIBearisharXiv – CS AI · May 297/10

🧠

Persona Conditioning of Brand Recommendations in Retrieval-Augmented Commercial Chat: A Prominence-Stratified Cross-Provider Audit

A comprehensive audit of three major AI models reveals that personalized user contexts significantly reshape brand recommendations in commercial AI assistants, with mid-market brands experiencing up to 75% recommendation volatility while category leaders maintain 80% consistency across personas. The study demonstrates that AI recommendation bias is strongly correlated with model architecture and retrieval strategies, with implications for fair evaluation and brand perception measurement.

🏢 OpenAI🏢 Anthropic

AIBearisharXiv – CS AI · May 127/10

🧠

Explanation Fairness in Large Language Models: An Empirical Analysis of Disparities in How LLMs Justify Decisions Across Demographic Groups

Researchers have identified systematic fairness disparities in how large language models explain their decisions across demographic groups, introducing the Explanation Fairness Taxonomy (EFT) to measure five dimensions of explanation inequality. Testing five major LLMs across hiring, medical, credit, and legal domains reveals statistically significant disparities in explanation quality, with stylistic inequalities appearing resistant to prompt-based fixes and likely embedded in model pre-training.

🧠 GPT-4🧠 Claude

AINeutralarXiv – CS AI · Jun 26/10

🧠

GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning

Researchers introduce GUDA, a machine unlearning-based method for attributing influence of training data groups to outputs in diffusion models. The approach approximates counterfactual scenarios without expensive full retraining, achieving ~100x speedup while more reliably identifying which artistic styles or object classes contributed to generated images compared to existing attribution methods.

🧠 Stable Diffusion