3 articles tagged with #ai-calibration. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers have identified a fundamental issue in large language models where verbalized confidence scores don't align with actual accuracy due to orthogonal encoding of these signals. They discovered a 'Reasoning Contamination Effect' where simultaneous reasoning disrupts confidence calibration, and developed a two-stage adaptive steering pipeline to improve alignment.
Research reveals that large language models can reproduce the qualitative structure of human social reasoning but struggle with quantitative magnitude calibration. Pragmatic prompting strategies that consider speaker knowledge and motives can improve this calibration, though fine-grained accuracy remains partially unresolved.
Researchers propose Knob, a new framework that applies control theory principles to neural networks by mapping gating dynamics to mechanical systems. The approach enables real-time human adjustment of AI model behavior through intuitive physical parameters like damping and frequency, offering both static and continuous processing modes.
