AINeutralarXiv – CS AI · May 127/10
🧠
The Open-Box Fallacy: Why AI Deployment Needs a Calibrated Verification Regime
Researchers propose replacing mechanistic interpretability requirements with 'calibrated verification' for AI deployment in sensitive domains like healthcare and criminal justice. The framework emphasizes domain-specific authorization, independent monitoring, and accountability mechanisms rather than demanding full model explainability, citing evidence that understanding model internals doesn't ensure safe real-world outcomes.
