y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#uncertainty-quantification News & Analysis

152 articles tagged with #uncertainty-quantification. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

152 articles
AINeutralarXiv – CS AI · May 115/10
🧠

Statistical inference with belief functions: A survey

This academic survey examines statistical inference methods within the belief functions framework, a mathematical approach for characterizing uncertainty when insufficient data prevents traditional probability distribution learning. The work reviews key contributions to inferring belief measures from statistical data, offering theoretical foundations relevant to uncertainty quantification in data-sparse environments.

AINeutralarXiv – CS AI · May 46/10
🧠

Position: agentic AI orchestration should be Bayes-consistent

A research position paper argues that agentic AI systems should incorporate Bayesian decision theory at their orchestration layer to improve decision-making under uncertainty. Rather than making LLMs themselves Bayesian, the framework proposes applying Bayesian principles to the control systems that coordinate multiple LLMs and tools, enabling better belief maintenance and resource allocation.

AIBullisharXiv – CS AI · May 16/10
🧠

General Uncertainty Estimation with Delta Variances

Researchers present Delta Variances, a computationally efficient method for estimating epistemic uncertainty in neural networks without requiring architectural changes or retraining. The technique shows competitive results with minimal computational overhead, demonstrated on a weather simulation task, offering practical uncertainty quantification for large-scale machine learning models.

AINeutralarXiv – CS AI · Apr 206/10
🧠

Beyond Surface Statistics: Robust Conformal Prediction for LLMs via Internal Representations

Researchers propose a conformal prediction framework for large language models that uses internal neural representations rather than surface-level outputs to assess reliability and uncertainty. The Layer-Wise Information scoring method improves prediction validity under distribution shift while maintaining competitive performance, addressing a critical challenge in deploying LLMs where traditional uncertainty signals become unreliable.

AINeutralarXiv – CS AI · Apr 156/10
🧠

Disposition Distillation at Small Scale: A Three-Arc Negative Result

Researchers attempted to train behavioral dispositions into small language models through distillation but found that initial positive results were artifacts of measurement errors. After rigorous validation, they discovered no reliable method to instill self-verification and uncertainty acknowledgment without degrading model performance or creating superficial stylistic mimicry across five different small models.

AINeutralarXiv – CS AI · Apr 146/10
🧠

SciPredict: Can LLMs Predict the Outcomes of Scientific Experiments in Natural Sciences?

Researchers introduce SciPredict, a benchmark testing whether large language models can predict scientific experiment outcomes across physics, biology, and chemistry. The study reveals that while some frontier models marginally exceed human experts (~20% accuracy), they fundamentally fail to assess prediction reliability, suggesting superhuman performance in experimental science requires not just better predictions but better calibration awareness.

AIBearisharXiv – CS AI · Apr 146/10
🧠

Calibration Collapse Under Sycophancy Fine-Tuning: How Reward Hacking Breaks Uncertainty Quantification in LLMs

A research study demonstrates that fine-tuning language models with sycophantic reward signals degrades their calibration—the ability to accurately quantify uncertainty—even as performance metrics improve. While the effect lacks statistical significance in this experiment, the findings reveal that reward-optimized models retain structured miscalibration even after post-hoc corrections, establishing a methodology for evaluating hidden degradation in fine-tuned systems.

AINeutralarXiv – CS AI · Apr 146/10
🧠

TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning

Researchers propose TokUR, a framework that enables large language models to estimate uncertainty at the token level during reasoning tasks, allowing LLMs to self-assess response quality and improve performance on mathematical problems. The approach uses low-rank random weight perturbation to generate predictive distributions, demonstrating strong correlation with answer correctness and potential for enhancing LLM reliability.

AINeutralarXiv – CS AI · Apr 136/10
🧠

Act or Escalate? Evaluating Escalation Behavior in Automation with Language Models

Researchers analyzed how large language models decide whether to act on predictions or escalate to humans, finding that models use inconsistent and miscalibrated thresholds across five real-world domains. Supervised fine-tuning on chain-of-thought reasoning proved most effective at establishing robust escalation policies that generalize across contexts, suggesting escalation behavior requires explicit characterization before AI system deployment.

AINeutralarXiv – CS AI · Apr 136/10
🧠

Practical Bayesian Inference for Speech SNNs: Uncertainty and Loss-Landscape Smoothing

Researchers demonstrate that applying Bayesian inference to Spiking Neural Networks (SNNs) for speech processing smooths the irregular loss landscape caused by threshold-based spike generation. Testing on speech datasets shows improved performance metrics and more regular predictive landscapes compared to deterministic approaches.

AINeutralarXiv – CS AI · Apr 136/10
🧠

VOLTA: The Surprising Ineffectiveness of Auxiliary Losses for Calibrated Deep Learning

Researchers introduce VOLTA, a simplified deep learning approach for uncertainty quantification that outperforms ten established baselines including ensemble methods and MC Dropout. The method achieves superior calibration with expected calibration error of 0.010 and competitive accuracy across multiple datasets, suggesting that complex auxiliary losses may be unnecessary for reliable uncertainty estimation in safety-critical applications.

AINeutralarXiv – CS AI · Apr 136/10
🧠

Every Response Counts: Quantifying Uncertainty of LLM-based Multi-Agent Systems through Tensor Decomposition

Researchers introduce MATU, a novel uncertainty quantification framework using tensor decomposition to address reliability challenges in Large Language Model-based Multi-Agent Systems. The method analyzes entire reasoning trajectories rather than single outputs, effectively measuring uncertainty across different agent structures and communication topologies.

AIBullisharXiv – CS AI · Mar 276/10
🧠

Reaching Beyond the Mode: RL for Distributional Reasoning in Language Models

Researchers developed a multi-answer reinforcement learning approach that trains language models to generate multiple plausible answers with confidence estimates in a single forward pass, rather than collapsing to one dominant answer. The method shows improved diversity and accuracy across question-answering, medical diagnosis, and coding benchmarks while being more computationally efficient than existing approaches.

AIBullisharXiv – CS AI · Mar 116/10
🧠

An AI-powered Bayesian Generative Modeling Approach for Arbitrary Conditional Inference

Researchers have developed Bayesian Generative Modeling (BGM), a new AI framework that enables flexible conditional inference on any partition of observed variables without retraining. The approach uses stochastic iterative Bayesian updating with theoretical guarantees for convergence and statistical consistency, offering a universal engine for conditional prediction with uncertainty quantification.

AINeutralarXiv – CS AI · Mar 55/10
🧠

Zono-Conformal Prediction: Zonotope-Based Uncertainty Quantification for Regression and Classification Tasks

Researchers introduce zono-conformal prediction, a new uncertainty quantification method for machine learning that uses zonotope-based prediction sets instead of traditional intervals. The approach is more computationally efficient and less conservative than existing conformal prediction methods while maintaining statistical coverage guarantees for both regression and classification tasks.

AIBullisharXiv – CS AI · Mar 55/10
🧠

HealthMamba: An Uncertainty-aware Spatiotemporal Graph State Space Model for Effective and Reliable Healthcare Facility Visit Prediction

Researchers have developed HealthMamba, a new AI framework that uses spatiotemporal modeling and uncertainty quantification to predict healthcare facility visits more accurately. The system achieved 6% better prediction accuracy and 3.5% improvement in uncertainty quantification compared to existing methods when tested on real-world datasets from four US states.

AIBullisharXiv – CS AI · Mar 37/108
🧠

DenoiseFlow: Uncertainty-Aware Denoising for Reliable LLM Agentic Workflows

Researchers introduce DenoiseFlow, a framework that addresses reliability issues in AI agent workflows by managing uncertainty through adaptive computation allocation and error correction. The system achieves 83.3% average accuracy across benchmarks while reducing computational costs by 40-56% through intelligent branching decisions.

$COMP
AIBullisharXiv – CS AI · Mar 36/107
🧠

Polynomial Surrogate Training for Differentiable Ternary Logic Gate Networks

Researchers introduce Polynomial Surrogate Training (PST) to enable differentiable ternary logic gate networks, reducing parameters by 2,187x while maintaining performance. The method extends beyond binary logic gates to ternary systems with an UNKNOWN state for uncertainty handling, training 2-3x faster than binary networks.

AIBullisharXiv – CS AI · Mar 36/106
🧠

CIRCUS: Circuit Consensus under Uncertainty via Stability Ensembles

Researchers introduce CIRCUS, a new method for discovering mechanistic circuits in AI models that addresses uncertainty and brittleness issues in current approaches. The technique creates ensemble attribution graphs and extracts consensus circuits that are 40x smaller while maintaining explanatory power, validated on Gemma-2-2B and Llama-3.2-1B models.

AIBullisharXiv – CS AI · Mar 36/108
🧠

IDER: IDempotent Experience Replay for Reliable Continual Learning

Researchers propose IDER (Idempotent Experience Replay), a new continual learning method that addresses catastrophic forgetting in neural networks while improving prediction reliability. The approach uses idempotent properties to help AI models retain previously learned knowledge when acquiring new tasks, with demonstrated improvements in accuracy and reduced computational overhead.

AIBullisharXiv – CS AI · Mar 26/1010
🧠

Uncertainty Quantification for Multimodal Large Language Models with Incoherence-adjusted Semantic Volume

Researchers introduce UMPIRE, a new training-free framework for quantifying uncertainty in Multimodal Large Language Models (MLLMs) across various input and output modalities. The system measures incoherence-adjusted semantic volume of model responses to better detect errors and improve reliability without requiring external tools or additional computational overhead.

AIBullisharXiv – CS AI · Mar 26/1011
🧠

Evidential Neural Radiance Fields

Researchers introduce Evidential Neural Radiance Fields, a new probabilistic approach that enables uncertainty quantification in 3D scene modeling while maintaining rendering quality. The method addresses critical limitations in existing NeRF technology by capturing both aleatoric and epistemic uncertainty from a single forward pass, making neural radiance fields more suitable for safety-critical applications.

AINeutralarXiv – CS AI · Mar 26/1010
🧠

RewardUQ: A Unified Framework for Uncertainty-Aware Reward Models

Researchers introduce RewardUQ, a unified framework for evaluating uncertainty quantification in reward models used to align large language models with human preferences. The study finds that model size and initialization have the most significant impact on performance, while providing an open-source Python package to advance the field.

AINeutralarXiv – CS AI · Apr 64/10
🧠

Equivariant Evidential Deep Learning for Interatomic Potentials

Researchers developed e²IP, a new framework for uncertainty quantification in machine learning interatomic potentials used in molecular dynamics simulations. The method uses equivariant evidential deep learning to model atomic forces and their uncertainty through symmetric covariance tensors that transform properly under rotations.

$IP
AINeutralarXiv – CS AI · Mar 174/10
🧠

Informative Perturbation Selection for Uncertainty-Aware Post-hoc Explanations

Researchers introduce EAGLE, a new framework for explaining black-box machine learning models using information-theoretic active learning to select optimal data perturbations. The method produces feature importance scores with uncertainty estimates and demonstrates improved explanation reproducibility and stability compared to existing approaches like LIME.

← PrevPage 6 of 7Next →