AINeutralarXiv – CS AI · May 16/10
🧠Researchers introduce VISE, the first benchmark for evaluating sycophancy in video large language models (Video-LLMs), where models incorrectly agree with user inputs that contradict visual evidence. The study proposes two training-free mitigation strategies: enhanced visual grounding through keyframe selection and inference-time neural representation steering, addressing a critical reliability gap in multimodal AI systems.
AIBullisharXiv – CS AI · Apr 146/10
🧠Researchers propose SVSR, a self-verification and self-rectification framework that enhances multimodal AI reasoning through a three-stage training approach combining preference datasets, supervised fine-tuning, and semi-online direct preference optimization. The method demonstrates improved accuracy and generalization across visual understanding tasks while maintaining performance even without explicit reasoning traces.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers propose TokUR, a framework that enables large language models to estimate uncertainty at the token level during reasoning tasks, allowing LLMs to self-assess response quality and improve performance on mathematical problems. The approach uses low-rank random weight perturbation to generate predictive distributions, demonstrating strong correlation with answer correctness and potential for enhancing LLM reliability.
AIBullisharXiv – CS AI · Apr 106/10
🧠Researchers propose fine-grained confidence calibration methods for large language models in automated code revision tasks, addressing the limitation of traditional global calibration approaches. By applying local Platt-scaling to task-specific confidence scores, the study demonstrates improved calibration accuracy across multiple code repair and refinement tasks, enabling developers to better trust LLM outputs.
AIBullisharXiv – CS AI · Apr 106/10
🧠Researchers propose a Self-Validation Framework to address object hallucination in Large Vision Language Models (LVLMs), where models generate descriptions of non-existent objects in images. The training-free approach validates object existence through language-prior-free verification and achieves 65.6% improvement on benchmark metrics, suggesting a novel path to enhance LVLM reliability without additional training.
AIBearisharXiv – CS AI · Apr 76/10
🧠Research reveals that Vision Language Models (VLMs) progressively lose visual grounding during reasoning tasks, creating dangerous low-entropy predictions that appear confident but lack visual evidence. The study found attention to visual evidence drops by over 50% during reasoning across multiple benchmarks, requiring task-aware monitoring for safe AI deployment.
AINeutralarXiv – CS AI · Apr 76/10
🧠A reproducibility study unifies research on spurious correlations in deep neural networks across different domains, comparing correction methods including XAI-based approaches. The research finds that Counterfactual Knowledge Distillation (CFKD) most effectively improves model generalization, though practical deployment remains challenging due to group labeling dependencies and data scarcity issues.
AIBullisharXiv – CS AI · Mar 276/10
🧠Researchers developed InstABoost, a new method to improve instruction following in large language models by boosting attention to instruction tokens without retraining. The technique addresses reliability issues where LLMs violate constraints under long contexts or conflicting user inputs, achieving better performance than existing methods across 15 tasks.
AINeutralarXiv – CS AI · Mar 266/10
🧠Researchers have developed LLMORPH, an automated testing tool for Large Language Models that uses Metamorphic Testing to identify faulty behaviors without requiring human-labeled data. The tool was tested on GPT-4, LLAMA3, and HERMES 2 across four NLP benchmarks, generating over 561,000 test executions and successfully exposing model inconsistencies.
🧠 GPT-4
AIBullisharXiv – CS AI · Mar 126/10
🧠Researchers developed and tested five prompt engineering strategies to reduce hallucinations in large language models for industrial applications. The Enhanced Data Registry method achieved 100% success rate in trials, while other methods showed varying degrees of improvement in producing consistent, factually grounded outputs.
AIBullisharXiv – CS AI · Mar 36/108
🧠Researchers introduce M-JudgeBench, a comprehensive benchmark for evaluating Multimodal Large Language Models (MLLMs) used as judges, and propose Judge-MCTS framework to improve judge model training. The work addresses systematic weaknesses in existing MLLM judge systems through capability-oriented evaluation and enhanced data generation methods.
AIBearisharXiv – CS AI · Mar 36/108
🧠Research reveals that Large Language Model (LLM) self-explanations fail semantic invariance testing, showing that AI models' self-reports change based on how tasks are framed rather than actual task performance. Four frontier AI models demonstrated unreliable self-reporting when faced with semantically different but functionally identical tool descriptions, raising questions about using model self-reports as evidence of capability.
AIBullisharXiv – CS AI · Mar 26/1010
🧠Researchers introduce UMPIRE, a new training-free framework for quantifying uncertainty in Multimodal Large Language Models (MLLMs) across various input and output modalities. The system measures incoherence-adjusted semantic volume of model responses to better detect errors and improve reliability without requiring external tools or additional computational overhead.
AIBullishHugging Face Blog · Jan 296/105
🧠The article announces the launch of The Hallucinations Leaderboard, an open initiative designed to measure and track hallucinations in large language models. This effort aims to provide transparency and benchmarking for AI model reliability across different systems.
AINeutralLil'Log (Lilian Weng) · Jul 75/10
🧠This article defines and categorizes hallucination in large language models, specifically focusing on extrinsic hallucination where model outputs are not grounded in world knowledge. The author distinguishes between in-context hallucination (inconsistent with provided context) and extrinsic hallucination (not verifiable by external knowledge), emphasizing that LLMs must be factual and acknowledge uncertainty to avoid fabricating information.
