y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#bayesian-inference News & Analysis

38 articles tagged with #bayesian-inference. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

38 articles
AINeutralarXiv – CS AI · Jun 26/10
🧠

Computation-Aware Kalman Filtering with Model Selection for Neural Dynamics

Researchers introduce CASSM, a Bayesian framework that combines Kalman filtering with model selection to improve neural dynamics modeling on modern datasets. The method addresses computational complexity and uncertainty calibration challenges, offering competitive performance with deep networks while maintaining better uncertainty quantification, particularly for datasets with fewer trials than recorded neurons.

AINeutralarXiv – CS AI · Jun 26/10
🧠

Hypothesis Generation and Inductive Inference in Children and Language Models

Researchers compared how human children and large language models approach inductive reasoning tasks under uncertainty, finding both similarities and critical differences in their information-seeking strategies. While LLMs replicate children's adaptive responses to environmental structure, they exhibit distinct biases toward over-observation and instruction compliance, suggesting fundamentally different underlying computational principles govern their decision-making.

AIBullisharXiv – CS AI · Jun 26/10
🧠

Optimal Bayesian Stopping for Efficient Inference of Consistent LLM Answers

Researchers propose a Bayesian stopping strategy that reduces LLM inference costs by up to 50% while maintaining answer accuracy. The method samples multiple LLM responses and stops once sufficient consistency is detected, using an efficient L-aggregated policy that tracks only the top 3 answer frequencies and achieves theoretical optimality.

AINeutralarXiv – CS AI · Jun 26/10
🧠

Mitigating Reward Hacking in RLHF via Bayesian Non-negative Reward Modeling

Researchers propose Bayesian Non-Negative Reward Model (BNRM), a framework that addresses reward hacking vulnerabilities in reinforcement learning from human feedback (RLHF) systems used to align large language models. The approach combines non-negative factor analysis with preference modeling to create more robust, interpretable reward systems resistant to biases and distribution shifts.

AINeutralarXiv – CS AI · May 286/10
🧠

Prefix-Safe Bayesian Belief Tracking for LLM Reasoning Reliability:Separating Calibration from Ranking

Researchers propose Sequential Bayesian Belief Tracking (SBBT), a framework for estimating the reliability of long reasoning chains in large language models before final answers are known. The study finds that probability calibration and ranking performance respond differently to various evidence types: scalar scores improve calibration metrics, while structural observations are needed for ranking tasks.

AINeutralarXiv – CS AI · May 286/10
🧠

Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors

Researchers introduce Multi-Teacher Bayesian Knowledge Distillation (MT-BKD), a framework that enables student models to learn from multiple teacher models while quantifying uncertainty through Bayesian inference. The approach uses teacher-informed priors and entropy-based weighting to improve model compression, generalization, and interpretability across synthetic and real-world tasks.

AIBullisharXiv – CS AI · May 286/10
🧠

Bayesian Gated Non-Negative Contrastive Learning

Researchers propose BayesNCL, a new machine learning approach that improves the interpretability of self-supervised learning models by using probabilistic gating to filter out task-irrelevant features. The method achieves a 142.1% improvement in semantic consistency on ImageNet-100 while maintaining downstream task performance, addressing a fundamental limitation in how contrastive learning models process information.

AINeutralarXiv – CS AI · May 116/10
🧠

Offline Policy Optimization with Posterior Sampling

Researchers propose Posterior Sampling-based Policy Optimization (PSPO), a novel approach to offline reinforcement learning that addresses the critical challenge of balancing model generalization with robustness against exploitation errors. By formulating dynamics modeling as Bayesian inference, PSPO enables safer learning from out-of-distribution data while maintaining theoretical convergence guarantees.

AIBullisharXiv – CS AI · May 96/10
🧠

BALAR : A Bayesian Agentic Loop for Active Reasoning

Researchers introduced BALAR, a Bayesian algorithm that enables large language models to engage in structured multi-turn dialogue by actively reasoning about missing information and strategically asking clarifying questions. The system demonstrated significant performance improvements across three diverse benchmarks—14.6% to 38.5% higher accuracy—without requiring fine-tuning, suggesting a more principled approach to interactive AI reasoning.

AINeutralarXiv – CS AI · Apr 136/10
🧠

Practical Bayesian Inference for Speech SNNs: Uncertainty and Loss-Landscape Smoothing

Researchers demonstrate that applying Bayesian inference to Spiking Neural Networks (SNNs) for speech processing smooths the irregular loss landscape caused by threshold-based spike generation. Testing on speech datasets shows improved performance metrics and more regular predictive landscapes compared to deterministic approaches.

AIBullisharXiv – CS AI · Mar 126/10
🧠

Dynamics-Predictive Sampling for Active RL Finetuning of Large Reasoning Models

Researchers propose Dynamics-Predictive Sampling (DPS), a new method that improves reinforcement learning finetuning of large language models by predicting which training prompts will be most informative without expensive computational rollouts. The technique models each prompt's learning progress as a dynamical system and uses Bayesian inference to select better training data, reducing computational overhead while achieving superior reasoning performance.

← PrevPage 2 of 2