y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#hallucinations News & Analysis

19 articles tagged with #hallucinations. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

19 articles
AIBullisharXiv – CS AI · 1d ago7/10
🧠

Correcting Visual Blur Induced by Attention Distraction to Reduce Hallucinations: Algorithm and Theory

Researchers identify that hallucinations in multimodal large language models stem from attention distraction mechanisms similar to human cognitive failures under divided focus. The study proposes AFIP, a training-free algorithm that corrects spatial attention inconsistencies and temporal attention fading to improve visual grounding and reduce false object generation.

AIBearishDecrypt · May 297/10
🧠

AI Models Can’t Agree on Basic Facts Most of the Time, Study Shows

A new study found that five frontier AI models disagreed on how to fact-check 67% of 1,000 real-world claims, raising critical concerns about AI reliability and consistency. This inconsistency highlights fundamental limitations in current large language models that could impact their deployment in high-stakes applications requiring factual accuracy.

AI Models Can’t Agree on Basic Facts Most of the Time, Study Shows
AIBullisharXiv – CS AI · May 77/10
🧠

Local Intrinsic Dimension Unveils Hallucinations in Diffusion Models

Researchers have identified local intrinsic dimension (LID) as the primary driver of hallucinations in diffusion models—the phenomenon where AI generates structurally impossible outputs like hands with extra fingers. They propose Intrinsic Quenching (IQ), a corrective mechanism that reduces these anomalies and shows particular promise for medical imaging applications.

AINeutralarXiv – CS AI · May 47/10
🧠

LLM-Oriented Information Retrieval: A Denoising-First Perspective

Researchers propose that information retrieval for LLMs requires a fundamental shift toward denoising—prioritizing signal quality over quantity—because unlike humans, language models are vulnerable to hallucinations when processing noisy or irrelevant data within limited context windows. The paper introduces a four-stage framework addressing IR challenges from inaccessibility to unverifiability, with practical applications across RAG systems, coding agents, and multimodal understanding.

AINeutralarXiv – CS AI · Apr 207/10
🧠

Why Fine-Tuning Encourages Hallucinations and How to Fix It

Researchers identify that supervised fine-tuning of large language models increases hallucinations by degrading pre-existing knowledge through semantic interference. The study proposes self-distillation and parameter freezing techniques to mitigate this problem while preserving task performance.

AINeutralarXiv – CS AI · Apr 157/10
🧠

Distorted or Fabricated? A Survey on Hallucination in Video LLMs

Researchers have conducted a comprehensive survey on hallucinations in Video Large Language Models (Vid-LLMs), identifying two core types—dynamic distortion and content fabrication—and their root causes in temporal representation limitations and insufficient visual grounding. The study reviews evaluation benchmarks, mitigation strategies, and proposes future directions including motion-aware encoders and counterfactual learning to improve reliability.

AINeutralarXiv – CS AI · Apr 147/10
🧠

Cognitive Pivot Points and Visual Anchoring: Unveiling and Rectifying Hallucinations in Multimodal Reasoning Models

Researchers identify a critical failure mode in multimodal AI reasoning models called Reasoning Vision Truth Disconnect (RVTD), where hallucinations occur at high-entropy decision points when models abandon visual grounding. They propose V-STAR, a training framework using hierarchical visual attention rewards and forced reflection mechanisms to anchor reasoning back to visual evidence and reduce hallucinations in long-chain tasks.

AIBearisharXiv – CS AI · Apr 137/10
🧠

From Dispersion to Attraction: Spectral Dynamics of Hallucination Across Whisper Model Scales

Researchers propose the Spectral Sensitivity Theorem to explain hallucinations in large ASR models like Whisper, identifying a phase transition between dispersive and attractor regimes. Analysis of model eigenspectra reveals that intermediate models experience structural breakdown while large models compress information, decoupling from acoustic evidence and increasing hallucination risk.

AINeutralarXiv – CS AI · Apr 77/10
🧠

When Do Hallucinations Arise? A Graph Perspective on the Evolution of Path Reuse and Path Compression

Researchers at arXiv have identified two key mechanisms behind reasoning hallucinations in large language models: Path Reuse and Path Compression. The study models next-token prediction as graph search, showing how memorized knowledge can override contextual constraints and how frequently used reasoning paths become shortcuts that lead to unsupported conclusions.

AINeutralarXiv – CS AI · Mar 177/10
🧠

Distributional Semantics Tracing: A Framework for Explaining Hallucinations in Large Language Models

Researchers introduce Distributional Semantics Tracing (DST), a new framework for explaining hallucinations in large language models by tracking how semantic representations drift across neural network layers. The method reveals that hallucinations occur when models are pulled toward contextually inconsistent concepts based on training correlations rather than actual prompt context.

AIBearisharXiv – CS AI · Mar 127/10
🧠

Quantifying Hallucinations in Language Language Models on Medical Textbooks

Research study finds that LLaMA-70B-Instruct hallucinated in 19.7% of medical Q&A responses despite high plausibility scores, highlighting significant reliability issues in AI healthcare applications. The study shows that lower hallucination rates correlate with higher usefulness scores, emphasizing the need for better safeguards in medical AI systems.

AIBullisharXiv – CS AI · 3d ago6/10
🧠

Domain-Shift-Aware Conformal Prediction for Large Language Models

Researchers propose Domain-Shift-Aware Conformal Prediction (DS-CP), a framework that improves reliability of large language model outputs by adapting conformal prediction methods to handle domain shift. The approach reweights calibration samples based on proximity to test prompts, delivering more reliable uncertainty quantification and reducing hallucinations in real-world deployments.

AIBearishFortune Crypto · May 286/10
🧠

Starbucks quietly retired its AI agent just months after deployment after it hallucinated coffee shop inventories and slowed down baristas

Starbucks decommissioned an AI agent deployed to manage inventory and operations after just months of use due to persistent hallucinations and performance degradation that ultimately slowed barista workflows. The failure highlights critical challenges in deploying large language models to real-world operational tasks where accuracy directly impacts business efficiency.

Starbucks quietly retired its AI agent just months after deployment after it hallucinated coffee shop inventories and slowed down baristas
AINeutralApple Machine Learning · Apr 136/10
🧠

Cram Less to Fit More: Training Data Pruning Improves Memorization of Facts

Researchers present a data pruning technique that improves how large language models memorize factual knowledge by optimizing training data distribution. The work, grounded in information-theoretic analysis, addresses the gap between theoretical model capacity and actual factual accuracy, offering practical methods to reduce hallucinations in knowledge-intensive tasks.

AINeutralarXiv – CS AI · Apr 106/10
🧠

Steering the Verifiability of Multimodal AI Hallucinations

Researchers have developed a method to control how verifiable AI hallucinations are in multimodal language models by distinguishing between obvious hallucinations (easily detected by humans) and elusive ones (harder to spot). Using a dataset of 4,470 human responses, they created targeted interventions that can fine-tune which types of hallucinations occur, enabling flexible control suited to different security and usability requirements.

AIBullisharXiv – CS AI · Mar 266/10
🧠

Mitigating LLM Hallucinations through Domain-Grounded Tiered Retrieval

Researchers propose a new four-phase architecture to reduce AI hallucinations using domain-specific retrieval and verification systems. The framework achieved win rates up to 83.7% across multiple benchmarks, demonstrating significant improvements in factual accuracy for large language models.

AIBullishGoogle DeepMind Blog · Dec 176/103
🧠

FACTS Grounding: A new benchmark for evaluating the factuality of large language models

Researchers have introduced FACTS Grounding, a new benchmark designed to evaluate how accurately large language models ground their responses in source material and avoid hallucinations. The benchmark includes a comprehensive evaluation system and online leaderboard to measure LLM factuality performance.