Researchers demonstrate that traditional explainable AI methods designed for static predictions fail when applied to agentic AI systems that make sequential decisions over time. The study shows attribution-based explanations work well for static tasks but trace-based diagnostics are needed to understand failures in multi-step AI agent behaviors.
Researchers developed a framework for analyzing AI diagnostic systems in clinical settings by preserving original AI inferences and comparing them with physician corrections. The study of 21 dermatological cases showed 71.4% exact agreement between AI and physicians, with 100% comprehensive concordance when using structured analysis methods.
IBM and UC Berkeley collaborated to develop IT-Bench and MAST diagnostic tools to identify and analyze failure points in enterprise AI agent deployments. The research addresses critical gaps in understanding why AI agents underperform in real-world business environments compared to controlled testing scenarios.
