y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#uncertainty-quantification News & Analysis

152 articles tagged with #uncertainty-quantification. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

152 articles
AIBullisharXiv – CS AI · Mar 267/10
🧠

SCoOP: Semantic Consistent Opinion Pooling for Uncertainty Quantification in Multiple Vision-Language Model Systems

Researchers developed SCoOP, a training-free framework that combines multiple Vision-Language Models to improve uncertainty quantification and reduce hallucinations in AI systems. The method achieves 10-13% better hallucination detection performance compared to existing approaches while adding only microsecond-level overhead to processing time.

AINeutralarXiv – CS AI · Mar 177/10
🧠

Efficient Federated Conformal Prediction with Group-Conditional Guarantee

Researchers propose group-conditional federated conformal prediction (GC-FCP), a new protocol that enables trustworthy AI uncertainty quantification across distributed clients while providing coverage guarantees for specific groups. The framework addresses challenges in federated learning for applications in healthcare, finance, and mobile sensing by creating compact weighted summaries that support efficient calibration.

AINeutralarXiv – CS AI · Mar 177/10
🧠

Uncertainty Quantification and Data Efficiency in AI: An Information-Theoretic Perspective

This research review examines methodologies for addressing AI systems' challenges with limited training data through uncertainty quantification and synthetic data augmentation. The paper presents formal approaches including Bayesian learning frameworks, information-theoretic bounds, and conformal prediction methods to improve AI performance in data-scarce environments like robotics and healthcare.

AINeutralarXiv – CS AI · Mar 117/10
🧠

Quantifying Uncertainty in AI Visibility: A Statistical Framework for Generative Search Measurement

A research study reveals that AI-powered search engines like Perplexity, SearchGPT, and Google Gemini produce highly variable citation results for identical queries, making single-run visibility metrics unreliable. The study demonstrates that citation distributions follow power-law patterns with substantial variability, and argues that uncertainty estimates are essential for accurate measurement of domain visibility in generative search.

🏢 OpenAI🏢 Perplexity🧠 Gemini
AINeutralarXiv – CS AI · Mar 97/10
🧠

Uncertainty Quantification in LLM Agents: Foundations, Emerging Challenges, and Opportunities

Researchers present a new framework for uncertainty quantification in AI agents, highlighting critical gaps in current research that focuses on single-turn interactions rather than complex multi-step agent deployments. The paper identifies four key technical challenges and proposes foundations for safer AI agent systems in real-world applications.

AIBullisharXiv – CS AI · Mar 57/10
🧠

Robust Adversarial Quantification via Conflict-Aware Evidential Deep Learning

Researchers developed Conflict-aware Evidential Deep Learning (C-EDL), a new uncertainty quantification approach that significantly improves AI model reliability against adversarial attacks and out-of-distribution data. The method achieves up to 90% reduction in adversarial data coverage and 55% reduction in out-of-distribution data coverage without requiring model retraining.

AIBullisharXiv – CS AI · Mar 57/10
🧠

Volumetric Directional Diffusion: Anchoring Uncertainty Quantification in Anatomical Consensus for Ambiguous Medical Image Segmentation

Researchers propose Volumetric Directional Diffusion (VDD), a new AI method for medical image segmentation that addresses uncertainty in 3D lesion analysis. VDD anchors generative models to consensus priors to maintain anatomical accuracy while capturing expert disagreements, achieving state-of-the-art uncertainty quantification on multiple medical datasets.

AINeutralarXiv – CS AI · Mar 47/103
🧠

Know When to Abstain: Optimal Selective Classification with Likelihood Ratios

Researchers developed new selective classification methods using likelihood ratio tests based on the Neyman-Pearson lemma, allowing AI models to abstain from uncertain predictions. The approach shows superior performance across vision and language tasks, particularly under covariate shift scenarios where test data differs from training data.

AINeutralarXiv – CS AI · Feb 277/105
🧠

On the Equivalence of Random Network Distillation, Deep Ensembles, and Bayesian Inference

Researchers establish theoretical connections between Random Network Distillation (RND), deep ensembles, and Bayesian inference for uncertainty quantification in deep learning models. The study proves that RND's uncertainty signals are equivalent to deep ensemble predictive variance and can mirror Bayesian posterior distributions, providing a unified theoretical framework for efficient uncertainty quantification methods.

AIBullisharXiv – CS AI · Jun 256/10
🧠

Enhancing Clinician Decision-Making via Uncertainty-Aware Multi-Expert Fusion for Stroke Rehabilitation

Researchers present xAARA, an AI system that enhances stroke rehabilitation assessment by analyzing multi-view video to provide ARAT scores with calibrated uncertainty and clinical explanations. The system achieved 94.2% task accuracy while reducing predictive uncertainty by 96.1% compared to single clinicians, with four independent clinicians validating its potential for clinical deployment.

AINeutralarXiv – CS AI · Jun 256/10
🧠

The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing

Researchers present evidence that safe autonomous AI prescribing requires three architectural safeguards: calibrated confidence thresholds, differentiated uncertainty communication, and decision transparency. A clinician survey of 136 U.S. prescribers reveals these features would substantially increase adoption but would effectively reduce AI systems from true autonomous agents to supervised decision-support tools.

AINeutralarXiv – CS AI · Jun 256/10
🧠

Confidence Sequences for Online Statistical Model Checking of Markov Decision Processes

Researchers present new confidence sequence methods for statistical model checking of Markov decision processes in online settings, achieving 50x sample efficiency improvements over previous approaches. The work addresses the practical problem of obtaining meaningful guarantees when exact transition probabilities are unknown, with applications to cyber-physical and biological systems.

AINeutralarXiv – CS AI · Jun 256/10
🧠

Uncertainty-aware reinforcement learning for chemical language models

Researchers propose uncertainty-aware reinforcement learning methods for chemical language models that account for prediction confidence when optimizing molecular properties. By incorporating predictive uncertainty into the optimization process, the approach improves hit discovery rates from 50% to 75% while maintaining molecular quality scores.

AINeutralarXiv – CS AI · Jun 256/10
🧠

UC-Search: Risk-Aware Test-Time Search for Delayed Constrained Time-Series Control

UC-Search is a model-agnostic test-time algorithm that combines time-series forecasting with constrained decision-making under uncertainty. The approach uses beam search and Monte Carlo tree search variants to optimize delayed control decisions while respecting feasibility constraints, demonstrating measurable improvements over existing methods like CEM and MPPI across inventory control and financial forecasting benchmarks.

AINeutralarXiv – CS AI · Jun 256/10
🧠

Uncertainty Quantification for Computer-Use Agents: A Benchmark across Vision-Language Models and GUI Grounding Datasets

Researchers released Argus, a comprehensive benchmark for uncertainty quantification in AI agents that control computers through GUI interactions. The study evaluated 27 uncertainty methods across multiple vision-language models and datasets, finding that uncertainty rankings remain stable within a single model but degrade significantly when switching between different model classes or interfaces.

AINeutralarXiv – CS AI · Jun 256/10
🧠

Reliable Conformal Prediction for Ordinal Classification Using the Ranked Probability Score

Researchers introduce a conformal prediction method for ordinal classification using the ranked probability score (RPS), a statistical approach that provides uncertainty quantification with guaranteed coverage properties. The technique produces contiguous prediction sets more efficiently than existing methods and shows improved performance across medical, financial, and image datasets.

AINeutralarXiv – CS AI · Jun 236/10
🧠

Fine-Grained Uncertainty Quantification for Long-Form Language Model Outputs: A Comparative Study

Researchers introduce a comprehensive framework for detecting hallucinations in long-form language model outputs through fine-grained uncertainty quantification, finding that simpler claim-level consistency methods outperform complex alternatives. The study provides practical guidance for improving factuality in extended LLM generations across STEM and geography domains.

AINeutralarXiv – CS AI · Jun 235/10
🧠

Learning Filters with Certainty

Researchers propose enhancing Counting Bloom Filters (CBFs) by leveraging certainty signals from hash collision information to improve machine learning model accuracy. This work demonstrates how traditional data structure design can be refined to provide probabilistic confidence metrics, enabling hybrid ML-filter architectures to make more informed decisions in applications like caching and anomaly detection.

AINeutralarXiv – CS AI · Jun 236/10
🧠

Neuronal Stochastic Attention Circuit (NSAC) for Probabilistic Representation Learning

Researchers introduce NSAC, a biologically-inspired continuous-time attention architecture that quantifies uncertainty in representation learning by reformulating attention computation as a stochastic differential equation. The approach combines theoretical stability guarantees with practical applications across forecasting, autonomous vehicles, and industrial systems, advancing uncertainty quantification in neural networks.

AINeutralarXiv – CS AI · Jun 235/10
🧠

UBP2: Uncertainty-Balanced Preference Planning for Efficient Preference-based Reinforcement Learning

Researchers introduce UBP2, a model-based reinforcement learning method that improves sample efficiency in preference-based learning by actively directing exploration through uncertainty quantification across reward, dynamics, and value functions. The approach achieves sublinear regret guarantees and demonstrates substantially higher sample efficiency than existing methods on benchmark tasks.

AINeutralarXiv – CS AI · Jun 236/10
🧠

The Origins of Stochasticity: Comprehensive Investigations on Uncertainty Quantification for Large Language Models

Researchers propose a comprehensive uncertainty quantification (UQ) framework for large language models, breaking down sources of error into input-level, parameter-level, token-level, and decoding-process components. Testing 21 UQ methods across Qwen3, Llama 3.2, and DeepSeek-V3 reveals that consensus-based approaches consistently outperform alternatives, while larger models exhibit lower uncertainty estimates according to an empirical scaling law.

🧠 Llama
AINeutralarXiv – CS AI · Jun 236/10
🧠

Latent Confidence Alignment for LLM Self-Assessment

Researchers propose Latent Confidence Alignment Error (LCAE), a new framework for evaluating how well large language models assess their own reliability by accounting for item difficulty and model ability. Testing on 20 medical-domain models shows the approach improves self-assessment quality without degrading performance, revealing a correlation between model reliability and computational inference costs.

← PrevPage 2 of 7Next →