y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#explainable-ai News & Analysis

118 articles tagged with #explainable-ai. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

118 articles
AINeutralarXiv – CS AI · 3d ago7/10
🧠

Towards Faithful Agentic XAI: A Verification Method and an Open-World Benchmark for Better Model Faithfulness

Researchers propose Faithful Agentic XAI (FAX), a framework that improves the reliability of AI explanations generated by large language models through explicit verification mechanisms. The study introduces CRAFTER-XAI-Bench, a new benchmark for testing explanation faithfulness in complex environments, demonstrating that current XAI systems can produce plausible but inaccurate explanations that mislead users.

AIBearisharXiv – CS AI · May 97/10
🧠

Evaluating Explainability in Safety-Critical ATR Systems: Limitations of Post-Hoc Methods and Paths Toward Robust XAI

A peer-reviewed study evaluates explainability methods in AI systems used for automatic target recognition in safety-critical applications, revealing that popular post-hoc explanation techniques have significant limitations including spurious explanations and vulnerability to manipulation. The research argues that current XAI approaches are insufficient for deployment in high-stakes environments and calls for more robust, causally-grounded methods that prioritize system assurance over visual plausibility.

AINeutralarXiv – CS AI · Apr 207/10
🧠

Towards Intrinsic Interpretability of Large Language Models:A Survey of Design Principles and Architectures

A new survey examines intrinsic interpretability approaches for Large Language Models, categorizing design methods that build transparency directly into model architectures rather than applying post-hoc explanations. The research identifies five key paradigms—functional transparency, concept alignment, representational decomposability, explicit modularization, and latent sparsity induction—addressing the critical challenge of making LLMs more trustworthy and safer for deployment.

AIBullisharXiv – CS AI · Apr 157/10
🧠

A Two-Stage LLM Framework for Accessible and Verified XAI Explanations

Researchers propose a two-stage LLM framework that uses one model to translate XAI technical outputs into natural language and a second model to verify accuracy, faithfulness, and completeness before delivering explanations to users. The framework includes iterative refinement mechanisms and demonstrates improved reliability across multiple XAI techniques and LLM families.

AINeutralarXiv – CS AI · Mar 277/10
🧠

Does Explanation Correctness Matter? Linking Computational XAI Evaluation to Human Understanding

A user study with 200 participants found that while explanation correctness in AI systems affects human understanding, the relationship is not linear - performance drops significantly at 70% correctness but doesn't degrade further below that threshold. The research challenges assumptions that higher computational correctness metrics automatically translate to better human comprehension of AI decisions.

AINeutralarXiv – CS AI · Mar 177/10
🧠

Why the Valuable Capabilities of LLMs Are Precisely the Unexplainable Ones

A research paper argues that the most valuable capabilities of large language models are precisely those that cannot be captured by human-readable rules. The thesis is supported by proof showing that if LLM capabilities could be fully rule-encoded, they would be equivalent to expert systems, which have been proven historically weaker than LLMs.

AIBullisharXiv – CS AI · Mar 97/10
🧠

RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Model

Researchers introduce RAG-Driver, a retrieval-augmented multi-modal large language model designed for autonomous driving that can provide explainable decisions and control predictions. The system addresses data scarcity and generalization challenges in AI-driven autonomous vehicles by using in-context learning and expert demonstration retrieval.

AINeutralarXiv – CS AI · Mar 97/10
🧠

From Features to Actions: Explainability in Traditional and Agentic AI Systems

Researchers demonstrate that traditional explainable AI methods designed for static predictions fail when applied to agentic AI systems that make sequential decisions over time. The study shows attribution-based explanations work well for static tasks but trace-based diagnostics are needed to understand failures in multi-step AI agent behaviors.

AIBullisharXiv – CS AI · Mar 46/103
🧠

COOL-MC: Verifying and Explaining RL Policies for Platelet Inventory Management

Researchers developed COOL-MC, a tool that combines reinforcement learning with model checking to verify and explain AI policies for platelet inventory management in blood banks. The system achieved a 2.9% stockout probability while providing transparent decision-making explanations for safety-critical healthcare applications.

AINeutralarXiv – CS AI · Mar 46/102
🧠

Beyond Factual Correctness: Mitigating Preference-Inconsistent Explanations in Explainable Recommendation

Researchers propose PURE, a new framework for AI-powered recommendation systems that addresses preference-inconsistent explanations - where AI provides factually correct but unconvincing reasoning that conflicts with user preferences. The system uses a select-then-generate approach to improve both evidence selection and explanation generation, demonstrating reduced hallucinations while maintaining recommendation accuracy.

AIBullisharXiv – CS AI · Mar 37/105
🧠

Toward Clinically Explainable AI for Medical Diagnosis: A Foundation Model with Human-Compatible Reasoning via Reinforcement Learning

Researchers have developed DeepMedix-R1, a foundation model for chest X-ray interpretation that provides transparent, step-by-step reasoning alongside accurate diagnoses to address the black-box problem in medical AI. The model uses reinforcement learning to align diagnostic outputs with clinical plausibility and significantly outperforms existing models in report generation and visual question answering tasks.

AINeutralarXiv – CS AI · Mar 37/104
🧠

Revealing Combinatorial Reasoning of GNNs via Graph Concept Bottleneck Layer

Researchers developed a new graph concept bottleneck layer (GCBM) that can be integrated into Graph Neural Networks to make their decision-making process more interpretable. The method treats graph concepts as 'words' and uses language models to improve understanding of how GNNs make predictions, achieving state-of-the-art performance in both classification accuracy and interpretability.

AINeutralarXiv – CS AI · Feb 277/105
🧠

Using the Path of Least Resistance to Explain Deep Networks

Researchers propose Geodesic Integrated Gradients (GIG), a new method for explaining AI model decisions that uses curved paths instead of straight lines to compute feature importance. The method addresses flawed attributions in existing approaches by integrating gradients along geodesic paths under a model-induced Riemannian metric.

AIBullishOpenAI News · May 97/106
🧠

Language models can explain neurons in language models

Researchers used GPT-4 to automatically generate explanations for how individual neurons behave in large language models and to evaluate the quality of those explanations. They have released a comprehensive dataset containing explanations and quality scores for every neuron in GPT-2, advancing AI interpretability research.

AIBullisharXiv – CS AI · 3d ago6/10
🧠

Tell Me a Story! Narrative-Driven XAI with Large Language Models

Researchers introduce XAIstories, a framework that uses Large Language Models to convert complex AI explanations (SHAP values and counterfactual explanations) into human-readable narratives. User studies show over 90% of general audiences find these AI-generated stories convincing, with data scientists viewing them as valuable for explaining AI decisions to non-technical stakeholders.

AINeutralarXiv – CS AI · 3d ago5/10
🧠

Developing an Intelligent Job Recommendation System Using Semantic Retrieval and Explainable AI Techniques

Researchers developed an intelligent job recommendation system combining TF-IDF lexical matching with Sentence-BERT semantic retrieval to improve job posting searches on recruitment platforms. The hybrid approach achieved strong performance metrics (Precision@10: 0.8032, nDCG@10: 0.9496) using only structured metadata fields, demonstrating that semantic and lexical techniques can effectively complement each other for explainable recommendations.

AINeutralarXiv – CS AI · 3d ago6/10
🧠

Identifying Explicit Parsimonious Piece-wise Polynomial Relationships in Industrial time-series: Application to manipulator robots

Researchers have developed an algorithm to identify parsimonious explicit piece-wise polynomial relationships in industrial time-series data, with application to robotic manipulator control. The method derives simpler, interpretable models that outperform deep neural networks on unseen contexts while maintaining computational efficiency.

AIBullisharXiv – CS AI · 4d ago6/10
🧠

ECSEL: Explainable Classification via Signomial Equation Learning

Researchers introduced ECSEL, an explainable classification method that learns symbolic equations to create interpretable machine learning models. The approach outperforms competing symbolic regression methods on benchmarks while maintaining computational efficiency and classification accuracy comparable to traditional ML models.

AINeutralarXiv – CS AI · 4d ago6/10
🧠

Can Broad Biomedical Knowledge be Contextualized into Scenario-Grounded Propositions?

Researchers introduce SCENE, a multi-agent AI framework that transforms general biomedical knowledge into specific, evidence-supported hypotheses grounded in experimental data. The system successfully identifies patient subgroups with different treatment responses in clinical trials and context-specific biological responses in genomic studies, bridging the gap between broad theoretical knowledge and actionable dataset-specific insights.

AIBullisharXiv – CS AI · 4d ago6/10
🧠

Explainable Cross-Disease Reasoning for Cardiovascular Risk Assessment from Low-Dose Computed Tomography

Researchers have developed an explainable AI framework that jointly assesses lung and cardiovascular health from low-dose chest CT scans by modeling cross-disease physiological interactions. The system achieves 91.9% AUC for cardiovascular disease screening and outperforms cardiac-specific baselines by explicitly reasoning through pulmonary findings to inform heart risk predictions.

AIBullishMIT News – AI · May 206/10
🧠

Building AI models that understand chemical principles

Connor Coley is advancing machine learning applications in chemistry to accelerate drug discovery and compound design. This work represents a convergence of AI with pharmaceutical research, enabling computational models to understand and predict chemical behavior more effectively than traditional methods.

Building AI models that understand chemical principles
Page 1 of 5Next →