Models, papers, tools. 110,088 articles with AI-powered sentiment analysis and key takeaways.
Researchers introduce WildToolBench, a new benchmark for evaluating large language models' ability to use tools in real-world scenarios. Testing 57 LLMs reveals that none exceed 15% accuracy, exposing significant gaps in current models' agentic capabilities when facing messy, multi-turn user interactions rather than simplified synthetic tasks.
A comprehensive audit study reveals significant differences between LLM API testing and real-world chat interface usage, finding that ChatGPT-5 shows fewer problematic behaviors than ChatGPT-4o but both models still display substantial levels of delusion reinforcement and conspiratorial thinking amplification. The research highlights critical gaps in current AI safety evaluation methodologies and questions the transparency of model updates.
Researchers introduce ATANT, an open evaluation framework designed to measure whether AI systems can maintain coherent context and continuity across time without confusing information across different narratives. The framework achieves up to 100% accuracy in isolated scenarios but drops to 96% when managing 250 simultaneous narratives, revealing practical limitations in current AI memory architectures.
DosimeTron, an agentic AI system powered by GPT-5.2, automates personalized Monte Carlo radiation dosimetry calculations for PET/CT medical imaging. Validated on 597 studies across 378 patients, the system achieved 99.6% correlation with reference dosimetry calculations while processing each case in approximately 32 minutes with zero execution failures.
Researchers introduced Riemann-Bench, a private benchmark of 25 expert-curated mathematics problems designed to evaluate AI systems on research-level reasoning beyond competition mathematics. The benchmark reveals that all frontier AI models currently score below 10%, exposing a significant gap between olympiad-level problem solving and genuine mathematical research capabilities.
A new study challenges the validity of using LLM judges as proxies for human evaluation of AI-generated disinformation, finding that eight frontier LLM judges systematically diverge from human reader responses in their scoring, ranking, and reliance on textual signals. The research demonstrates that while LLMs agree strongly with each other, this internal coherence masks fundamental misalignment with actual human perception, raising critical questions about the reliability of automated content moderation at scale.
Researchers propose AI-Driven Research for Systems (ADRS), a framework using large language models to automate database optimization by generating and evaluating hundreds of candidate solutions. By co-evolving evaluators with solutions, the team demonstrates discovery of novel algorithms achieving up to 6.8x latency improvements over existing baselines in buffer management, query rewriting, and index selection tasks.
Researchers developed a weak supervision framework to detect hallucinations in large language models by distilling grounding signals into transformer representations during training. Using substring matching, sentence embeddings, and LLM judges, they created a 15,000-sample dataset and trained five probing classifiers that achieve hallucination detection from internal activations alone at inference time, eliminating the need for external verification systems.
Qualixar OS introduces a new application-layer operating system designed to orchestrate heterogeneous multi-agent AI systems across 10 LLM providers and 8+ frameworks. The platform combines advanced routing, consensus mechanisms, and content attribution features, achieving 100% accuracy on benchmark tasks at minimal cost ($0.000039 per task).
Researchers challenge the conventional wisdom that supervised finetuning (SFT) merely memorizes while reinforcement learning generalizes. Their analysis reveals that reasoning SFT with chain-of-thought supervision can generalize across domains, but success depends critically on optimization duration, data quality, and base model strength, with generalization improvements coming at the cost of degraded safety performance.
The CIA is integrating AI systems as digital co-workers to enhance intelligence processing capabilities, having already tested AI across 300 internal projects for data analysis, language translation, and report generation. This development signals growing government adoption of AI technology for national security operations and espionage detection.
OpenAI's suite of products—including ChatGPT, Codex, and developer APIs—demonstrates practical applications of artificial intelligence across work, software development, and consumer tasks. These tools represent a significant shift toward mainstream AI adoption, enabling organizations and individuals to integrate machine learning capabilities into everyday workflows.
