AIBearisharXiv – CS AI · 5d ago7/10
🧠Researchers challenge the assumption that uncertainty estimation methods can reliably detect LLM hallucinations, finding highly variable and often weak associations across different hallucination types. The study evaluates multiple uncertainty quantification approaches against intrinsic and extrinsic hallucinations, revealing that uncertainty signals may not consistently indicate model failures.
AIBullisharXiv – CS AI · Apr 207/10
🧠Researchers introduce Sequential Internal Variance Representation (SIVR), a novel supervised framework for detecting hallucinations in large language models by analyzing token-wise and layer-wise variance patterns in hidden states. The method demonstrates superior generalization compared to existing approaches while requiring smaller training datasets, potentially enabling practical deployment of hallucination detection systems.
AIBullisharXiv – CS AI · Apr 137/10
🧠Researchers propose Evidential Transformation Network (ETN), a lightweight post-hoc module that converts pretrained models into evidential models for uncertainty estimation without retraining. ETN operates in logit space using sample-dependent affine transformations and Dirichlet distributions, demonstrating improved uncertainty quantification across vision and language benchmarks with minimal computational overhead.
AIBullisharXiv – CS AI · Mar 97/10
🧠Researchers propose a three-stage pipeline to train Large Language Models to efficiently provide calibrated uncertainty estimates for their responses. The method uses entropy-based scoring, Platt scaling calibration, and reinforcement learning to enable models to reason about uncertainty without computationally expensive post-hoc methods.
AIBullisharXiv – CS AI · Mar 56/10
🧠Researchers introduce JANUS, a new AI framework that solves the 'Quadrilemma' in synthetic data generation by achieving high fidelity, logical constraint control, reliable uncertainty estimation, and computational efficiency simultaneously. The system uses Bayesian Decision Trees and a novel Reverse-Topological Back-filling algorithm to guarantee 100% constraint satisfaction while being 128x faster than existing methods.
AIBullisharXiv – CS AI · Mar 37/103
🧠Researchers have developed Value Flows, a new reinforcement learning method that uses flow-based models to estimate complete return distributions rather than single scalar values. The approach achieves 1.3x improvement in success rates across 62 benchmark tasks by better identifying states with high return uncertainty for improved decision-making.
AINeutralarXiv – CS AI · 4d ago5/10
🧠Researchers propose Under-Cali, a machine learning framework for forecasting irregular multivariate time series data in real-time online settings. The system uses uncertainty estimation and dual-expert calibration to maintain accuracy despite dynamic data distribution shifts, achieving improvements over existing methods with minimal computational overhead.
AIBullisharXiv – CS AI · 5d ago6/10
🧠Researchers propose LEC (Linear Expectation Constraints), a framework for controlling prediction errors in foundation models by setting user-specified risk thresholds. The method enables selective prediction systems and multi-model routing architectures to maintain statistical guarantees on error rates while maximizing the number of accepted predictions, with applications spanning QA and vision tasks.
AIBullisharXiv – CS AI · May 126/10
🧠SGC-RML is a new AI framework that improves Parkinson's disease assessment by combining speech, gait, and wearable sensor data while providing reliability estimates and confidence measures. The model achieves strong predictive performance across multiple datasets and can reject uncertain assessments or recommend retesting, addressing critical gaps in real-world digital health monitoring.
AINeutralarXiv – CS AI · May 96/10
🧠Researchers propose a regime theory framework for selecting controller classes in language and vision-language models, determining whether AI systems should answer directly, retrieve evidence, defer to stronger models, or abstain. The work demonstrates that model expressivity doesn't uniformly improve performance in finite samples, and provides a principled method to match controller complexity to data availability across multiple benchmarks.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers propose TokUR, a framework that enables large language models to estimate uncertainty at the token level during reasoning tasks, allowing LLMs to self-assess response quality and improve performance on mathematical problems. The approach uses low-rank random weight perturbation to generate predictive distributions, demonstrating strong correlation with answer correctness and potential for enhancing LLM reliability.
AIBearisharXiv – CS AI · Mar 266/10
🧠Research reveals that RLHF-aligned language models suffer from 'alignment tax' - producing homogenized responses that severely impair uncertainty estimation methods. The study found 40-79% of questions on TruthfulQA generate nearly identical responses, with alignment processes like DPO being the primary cause of this response homogenization.
AIBullisharXiv – CS AI · Mar 126/10
🧠Researchers introduce CUPID, a plug-in framework that estimates both aleatoric and epistemic uncertainty in deep learning models without requiring model retraining. The modular approach can be inserted into any layer of pretrained networks and provides interpretable uncertainty analysis for high-stakes AI applications.
AINeutralarXiv – CS AI · Mar 116/10
🧠Research reveals that LLMs heavily concentrate their confidence scores on just three round numbers when using standard 0-100 scales, with over 78% of responses showing this pattern. The study demonstrates that using a 0-20 confidence scale significantly improves metacognitive efficiency compared to the conventional 0-100 format.
AIBullisharXiv – CS AI · Mar 165/10
🧠Researchers developed an improved Residual Reinforcement Learning method that uses uncertainty estimation to enhance sample efficiency and work with stochastic base policies. The approach outperformed existing methods in simulation benchmarks and demonstrated successful zero-shot sim-to-real transfer in real-world deployments.
AINeutralMarkTechPost · Mar 105/10
🧠This tutorial demonstrates building an advanced AI agent system that incorporates risk-awareness through internal criticism, self-consistency reasoning, and uncertainty estimation. The system evaluates responses across multiple dimensions including accuracy, coherence, and safety while implementing risk-sensitive selection strategies for more reliable decision-making.
AINeutralarXiv – CS AI · Mar 34/104
🧠Researchers introduce Uncertainty Structure Estimation (USE), a new preprocessing method for semi-supervised learning that improves model reliability by filtering out low-quality unlabeled data. The approach uses entropy scores and statistical thresholds to identify and remove out-of-distribution samples before training, demonstrating consistent accuracy improvements across imaging and NLP tasks.
$NEAR
