AINeutralarXiv – CS AI · May 286/10
🧠Researchers introduce AsyncTool, a benchmark for evaluating how well LLM-based agents handle multiple concurrent tasks with realistic tool response delays. The study reveals that current AI agents struggle significantly with asynchronous multitasking, experiencing substantial performance degradation when tool feedback is delayed, highlighting a critical gap in real-world applicability.
AINeutralarXiv – CS AI · May 286/10
🧠Researchers introduce SONIC-O1, a comprehensive benchmark for evaluating multimodal large language models on audio-video understanding tasks. The study reveals significant performance gaps between closed-source and open-source models, particularly in temporal localization, and identifies demographic disparities in model behavior across 60 hours of real-world conversational data.
🏢 Hugging Face
AINeutralarXiv – CS AI · May 126/10
🧠Researchers introduce EgoMemReason, a comprehensive benchmark for evaluating AI systems on week-long egocentric video understanding through memory-driven reasoning. The benchmark reveals that even state-of-the-art multimodal models achieve only 39.6% accuracy, indicating that long-horizon memory and temporal reasoning remain unsolved challenges for next-generation visual assistants.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers introduce AdaTKG, a novel machine learning approach for temporal knowledge graph reasoning that maintains adaptive per-entity memory updated with each interaction, enabling better predictions on evolving relational data and improved handling of unseen entities compared to existing static representation methods.
AINeutralarXiv – CS AI · May 76/10
🧠Researchers present a neuro-symbolic framework that challenges the conventional belief that temporal reasoning failures in LLMs stem from inherent logical deduction deficits. By decoupling text-to-event representation from symbolic reasoning using a Probabilistic Inconsistency Signal, the framework achieves perfect accuracy on structured temporal tasks and identifies that representation quality—not reasoning capability—is the true bottleneck.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers introduce TimeSeriesExamAgent, a scalable framework for automatically generating time series reasoning benchmarks using LLM agents and templates. The study reveals that while large language models show promise in time series tasks, they significantly underperform in abstract reasoning and domain-specific applications across healthcare, finance, and weather domains.
AINeutralarXiv – CS AI · Apr 76/10
🧠Researchers have developed LiveFact, a new dynamic benchmark for evaluating Large Language Models' ability to detect fake news and misinformation in real-time conditions. The benchmark addresses limitations of static testing by using temporal evidence sets and finds that open-source models like Qwen3-235B-A22B now match proprietary systems in performance.
AINeutralarXiv – CS AI · Mar 176/10
🧠Research reveals that Large Language Models struggle with dynamic Theory of Mind tasks, particularly tracking how others' beliefs change over time. While LLMs can infer current beliefs effectively, they fail to maintain and retrieve prior belief states after updates occur, showing patterns consistent with human cognitive biases.
AIBearisharXiv – CS AI · Mar 176/10
🧠Researchers introduce HEARTS, a comprehensive benchmark for evaluating large language models' ability to reason over health time series data across 16 datasets and 12 health domains. The study reveals that current LLMs significantly underperform compared to specialized models and struggle with multi-step temporal reasoning in healthcare applications.
AIBullisharXiv – CS AI · Mar 37/108
🧠Researchers have developed Egocentric Co-Pilot, a web-native AI framework that runs on smart glasses and uses Large Language Models to provide assistive AI without requiring screens or free hands. The system combines perception, reasoning, and web tools to support accessibility for people with vision impairments or cognitive overload, showing superior performance compared to commercial baselines.
