CalVerT: Augmenting Agents with Calibrated Verifier Telemetry Improves Action and Learning in Knowledge-Intensive Tasks
CalVerT is a new framework that enhances LLM agents by providing calibrated confidence scores and grounding verification, helping agents distinguish between reliable and uncertain knowledge during question-answering tasks. The approach reduces both inaccurate confident answers and wasteful over-retrieval, improving performance across multiple QA benchmarks without requiring additional training.