y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#model-reliability News & Analysis

54 articles tagged with #model-reliability. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

54 articles
AIBearisharXiv – CS AI · Mar 36/108
🧠

LLM Self-Explanations Fail Semantic Invariance

Research reveals that Large Language Model (LLM) self-explanations fail semantic invariance testing, showing that AI models' self-reports change based on how tasks are framed rather than actual task performance. Four frontier AI models demonstrated unreliable self-reporting when faced with semantically different but functionally identical tool descriptions, raising questions about using model self-reports as evidence of capability.

AIBullisharXiv – CS AI · Mar 26/1010
🧠

Uncertainty Quantification for Multimodal Large Language Models with Incoherence-adjusted Semantic Volume

Researchers introduce UMPIRE, a new training-free framework for quantifying uncertainty in Multimodal Large Language Models (MLLMs) across various input and output modalities. The system measures incoherence-adjusted semantic volume of model responses to better detect errors and improve reliability without requiring external tools or additional computational overhead.

AINeutralLil'Log (Lilian Weng) · Jul 75/10
🧠

Extrinsic Hallucinations in LLMs

This article defines and categorizes hallucination in large language models, specifically focusing on extrinsic hallucination where model outputs are not grounded in world knowledge. The author distinguishes between in-context hallucination (inconsistent with provided context) and extrinsic hallucination (not verifiable by external knowledge), emphasizing that LLMs must be factual and acknowledge uncertainty to avoid fabricating information.

← PrevPage 3 of 3