"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessment

A qualitative study with 26 non-AI expert stakeholders reveals that everyday users assess AI fairness more comprehensively than AI experts, considering broader features beyond legally protected categories and setting stricter fairness thresholds. The research highlights the importance of incorporating stakeholder perspectives in AI governance and fairness assessment processes.

• →Stakeholders without AI expertise consider features far beyond legally protected categories when assessing AI fairness.
• →Non-experts tailor fairness metrics for specific contexts rather than applying universal standards.
• →Stakeholders set more diverse and stricter fairness thresholds compared to typical AI expert practices.
• →The study suggests stakeholders prefer designing customized fairness approaches rather than one-size-fits-all solutions.
• →Incorporating stakeholder perspectives could significantly improve AI fairness governance and mitigation strategies.