#faithfulness-metrics News & Analysis

2 articles tagged with #faithfulness-metrics. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · 5h ago7/10

🧠

The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning

Researchers identify the 'Reasoning Trap,' a fundamental information-theoretic limitation where multi-agent language model debates preserve answer accuracy while degrading reasoning quality. The study introduces the Supported Faithfulness Score metric and Evidence-Grounded Socratic Reasoning framework, demonstrating that closed-system reasoning protocols following standard multi-agent debate structures inevitably lose information fidelity according to the Data Processing Inequality.

AIBearisharXiv – CS AI · Mar 36/103

🧠

GNN Explanations that do not Explain and How to find Them

Researchers have identified critical failures in Self-explainable Graph Neural Networks (SE-GNNs) where explanations can be completely unrelated to how the models actually make predictions. The study reveals that these degenerate explanations can hide the use of sensitive attributes and can emerge both maliciously and naturally, while existing faithfulness metrics fail to detect them.