AINeutralarXiv – CS AI · 6h ago6/10
🧠
The Confident Liar: Diagnosing Multi-Agent Debate with Log-Probabilities and LLM-as-Judge
Researchers analyze multi-agent debate systems in AI by examining whether internal confidence signals (log-probabilities) correlate with external reasoning quality assessments and task accuracy. The study reveals significant role asymmetry between debating agents, with confidence metrics predicting reasoning quality twice as strongly for constructive agents compared to auditing agents, suggesting debate systems may have inherent structural biases.