152 articles tagged with #uncertainty-quantification. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers introduce Stochastic Lifting, a machine learning technique that generates diverse trajectories of stochastic physical systems by attaching random labels to state transitions during training. The method enables single-network inference to produce multiple plausible outcomes without collapsing to average predictions, advancing physics-informed AI applications.
Researchers have developed a mathematical framework that preserves closed-form variational inference when composing multiple probabilistic models together, traditionally a challenge that breaks analytical tractability. By identifying five core factor-graph primitives and proving their composability, the work enables Bayesian mixture-of-experts models with inferred gating functions, demonstrated through improved ensemble forecasting with calibrated uncertainty.
EviLink is a new AI framework that improves Text-to-SQL systems by treating schema linking as an uncertainty-aware process across multiple SQL paths rather than a single deterministic selection. The approach balances schema completeness, relevance, and computational cost, achieving 90.15% field-level recall on Spider2-Snow while using fewer tokens than existing methods.
Researchers propose Energy-Aware NECO, a single-pass machine learning method for detecting out-of-distribution data in semantic segmentation tasks. The hybrid approach combines geometric and energy-based scoring to achieve 85.39% detection accuracy while maintaining computational efficiency for edge deployment on mobile robots.
Researchers evaluated the calibration properties of five recent time series foundation models and found they maintain better confidence alignment than traditional deep learning approaches. Unlike typical neural networks that exhibit overconfidence, these foundation models demonstrate reliable uncertainty quantification across various forecasting scenarios, which is critical for real-world deployment in financial and operational decision-making.
Researchers introduce EvaluatorDPT, a decision-control model that predicts YES, NO, or TBD (to-be-determined) for high-stakes AI applications where uncertainty exists. The system learns deferral as an explicit outcome rather than hiding uncertainty in forced predictions, achieving 82.6% accuracy with auditable, policy-governed decision routing that can be inspected and controlled at inference time.
Researchers introduce Multi-Teacher Bayesian Knowledge Distillation (MT-BKD), a framework that enables student models to learn from multiple teacher models while quantifying uncertainty through Bayesian inference. The approach uses teacher-informed priors and entropy-based weighting to improve model compression, generalization, and interpretability across synthetic and real-world tasks.
Researchers provide the first rigorous theoretical analysis of temperature scaling, a widely-used technique for controlling uncertainty in machine learning models. The study reveals that while temperature scaling reliably increases entropy in classifiers, it does not necessarily increase diversity in large language models as commonly claimed, and establishes temperature scaling as the unique linear calibration method that preserves hard predictions.
Researchers introduce Helicase, an autonomous multi-agent LLM system designed to construct supply chain knowledge graphs by synthesizing fragmented web data through multi-hop reasoning. The system incorporates uncertainty quantification across three layers to enable calibrated confidence assessment, addressing a critical gap in complex supply chain intelligence tasks that cannot be solved by single-document queries.
Researchers present Belief-Aware GSAC, an adaptive knowledge distillation method for autonomous driving that modulates teacher guidance based on ensemble disagreement. Testing reveals that adaptive guidance helps under mild-to-moderate partial observability but fails under severe occlusion due to 'observability blindness'—where ensembles achieve low disagreement on visible data while missing occluded information.
Researchers introduce Structure-Adaptive Conformal Inference (SCQ and P-TAMS), a statistical framework that improves out-of-distribution testing in machine learning by incorporating auxiliary structural information like spatiotemporal patterns. The approach provides finite-sample error-rate control and enhanced interpretability compared to traditional conformal methods, with applications in high-stakes prediction scenarios.
Researchers propose 'resilience,' a novel uncertainty estimation method for Neural Cellular Automata (NCA) in medical image segmentation that identifies unreliable predictions by testing model stability under perturbations, without requiring architectural changes or retraining.
Researchers introduce MiRD, a two-stage framework that improves reliable prediction for open-ended question answering by separately addressing sampling failures and selection errors. The approach maintains calibration-set integrity while controlling hallucinations in AI models, outperforming existing conformal prediction methods across multiple datasets and models.
Researchers propose UCPO (Uncertainty-Aware Policy Optimization), a new reinforcement learning framework designed to improve large language model reliability by addressing advantage bias and reward hacking in uncertainty-based training. The method uses ternary advantage decoupling and dynamic reward adjustment to better calibrate model confidence levels in high-stakes applications.
Researchers propose Cascaded Sensing, a machine learning framework combining autoencoders and diffusion models to reconstruct physical fields from extremely sparse sensor measurements. The approach addresses the ill-posed problem of inferring complete spatial data from limited observations by first establishing global structural anchors through coarse-scale estimation, then refining details through conditional diffusion sampling.
Researchers propose MedMSA, a framework combining language models with formal probabilistic models to enable AI systems to make transparent, calibrated clinical predictions under uncertainty. The approach addresses critical limitations in current medical AI by producing verifiable differential diagnoses that explain patient symptoms with uncertainty weighting, marking progress toward safer clinical decision support.
NoisyCoconut is an inference-time method that improves LLM reliability by injecting controlled noise into internal representations to generate diverse reasoning paths, enabling models to abstain when uncertain without requiring retraining. The technique reduces error rates from 40-70% to below 15% on mathematical reasoning tasks through unanimous agreement among noise-perturbed paths, offering practical reliability improvements compatible with existing models.
Researchers propose Path-Coupled Bellman Flows (PCBF), a novel distributional reinforcement learning method that addresses limitations in existing flow-based approaches by using source-consistent paths and shared noise coupling to improve training stability and return distribution fidelity. The approach demonstrates competitive performance on benchmark tasks while maintaining computational efficiency through variance-reduction techniques.
Researchers introduce Free Energy Manifold (FEM), a score-based conditional energy model designed to improve probabilistic inference in hybrid Bayesian networks containing both discrete and continuous variables. The work identifies and addresses a critical failure mode called the mode-bridge artifact, where standard energy models create artificially low-energy paths between separated probability modes, leading to overconfident predictions in regions not seen during training.
Researchers question whether routing traces in Attention-Residual transformers provide genuine evidence of improved post-hoc calibration beyond standard confidence metrics. Through rigorous statistical testing with matched controls, the study finds that routing-specific features offer minimal stable evidence of better calibration, suggesting previous claims of calibration improvements may reflect methodological artifacts rather than true model improvements.
Researchers present a framework for optimally combining algorithmic risk scoring with direct verification screening in resource allocation decisions. The study demonstrates that even perfect predictive models cannot eliminate misallocation due to irreducible uncertainty about individual vulnerability, and shows that screening is most effective when focused on borderline cases rather than high-risk units.
Researchers propose using conditional optimal transport to improve calibration of Process Reward Models (PRMs) used in AI inference-time scaling, addressing the problem of overestimated success probabilities. The method enables better confidence bounds for mathematical reasoning tasks and improves downstream performance in Best-of-N selection frameworks.
Researchers introduce Causal EpiNets, a neural network framework that improves estimation of individual treatment effects using Probability of Necessity and Sufficiency bounds. The method resolves critical limitations in finite-sample estimation by guaranteeing structural constraint satisfaction and correcting extremum bias, achieving better coverage and validity than standard plug-in estimators.
Researchers demonstrate that EEG-based deep learning models produce unstable predictions when preprocessing pipelines change, with up to 42% of predictions flipping across different preprocessing choices. The study introduces three tools—Walsh-Hadamard decomposition, Preprocessing Uncertainty metrics, and a regularization approach—to measure and mitigate this instability, revealing a critical reliability gap in brain-computer interface systems.
Researchers introduce POETS, a novel framework that optimizes large language models through compute-efficient policy ensembles while quantifying uncertainty. By leveraging KL-regularized Thompson sampling and shared backbone architectures with independent LoRA branches, POETS achieves superior sample efficiency in scientific discovery tasks while reducing computational overhead compared to traditional ensemble methods.
