#cultural-fairness News & Analysis

2 articles tagged with #cultural-fairness. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBearisharXiv – CS AI · Jun 237/10

🧠

Jury Duty: Calibration and Orientation Failures in MLLM-as-a-Judge Under Cultural Ambiguity

Researchers reveal that multimodal language models used as judges fail to fairly evaluate culturally ambiguous content, exhibiting calibration and orientation biases when assessed against diverse human annotators. The study demonstrates these models systematically favor one cultural perspective while compressing their scoring scales, with implications for any AI system deployed across cultural contexts.

AINeutralarXiv – CS AI · Jun 27/10

🧠

IndoBias: A Dual Track Culturally Grounded Benchmark for LLMs Bias Evaluation in Indonesian Languages

Researchers introduced IndoBias, a benchmark specifically designed to evaluate bias in Large Language Models across Indonesian and three local languages (Javanese, Sundanese, Makasar). The study reveals that existing LLMs exhibit significant bias toward prototypical Indonesian sentences and particularly strong bias in local languages regarding ideology and religion, highlighting the critical gap in bias research for culturally and linguistically diverse contexts.