255 articles tagged with #ai-reliability. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
AI coding assistants like GPT-5 are experiencing a decline in quality, with newer models generating code that runs without syntax errors but produces incorrect results silently. This represents a shift from easily debuggable crashes to more dangerous silent failures that are harder to detect and fix.
Researchers developed TRACE, a framework to evaluate how LLMs allocate trust between conflicting software artifacts like code, documentation, and tests. The study found that current LLMs are better at identifying natural-language specification issues than detecting subtle code-level problems, with models showing systematic blind spots when implementations drift while documentation remains plausible.
A research paper introduces metamorphic testing as a solution for testing AI and LLM-integrated software systems. The approach addresses the challenge of unreliable LLM outputs and limited labeled ground truth by using relationships between multiple test executions as test oracles.
A research study examined how generative AI models perform in business decision-making contexts, particularly their ability to detect ambiguity and resist sycophantic behavior. The study found that while AI excels at identifying contradictions and contextual ambiguities, it struggles with linguistic nuances and requires human oversight to function as a reliable strategic partner.
Researchers are developing new methods to detect hallucinations in large language models by identifying specific spans of unsupported content rather than making binary decisions. The study evaluates Chain-of-Thought reasoning approaches to improve the complex multi-step process of hallucination span detection in LLMs.
