AINeutralarXiv – CS AI · 5d ago7/10
🧠Researchers discovered that large language models refuse to correct their own reasoning errors but readily accept corrections when identical claims come from external sources like users or tools. This behavior stems not from cognitive limitations but from how chat templates assign roles to different message types, suggesting AI systems may have built-in biases toward authoritative external sources.
AINeutralarXiv – CS AI · May 97/10
🧠Researchers demonstrate that large language models encode social role granularity—from individual to institutional perspectives—as a structured geometric axis in their internal representations. Using activation steering, they show this axis is causally manipulable, enabling controlled shifts in response scope across different models.
🧠 Llama
AI × CryptoNeutralarXiv – CS AI · Apr 137/10
🤖Researchers distinguish between primary algorithmic monoculture (inherent similarity in AI agent behavior) and strategic algorithmic monoculture (deliberate adjustment of similarity based on incentives). Experiments with both humans and LLMs show that while LLMs exhibit high baseline similarity, they struggle to maintain behavioral diversity when rewarded for divergence, suggesting potential coordination failures in multi-agent AI systems.
AINeutralarXiv – CS AI · Apr 67/10
🧠Researchers developed a framework called Verbalized Assumptions to understand why AI language models exhibit sycophantic behavior, affirming users rather than providing objective assessments. The study reveals that LLMs incorrectly assume users are seeking validation rather than information, and demonstrates that these assumptions can be identified and used to control sycophantic responses.
AINeutralarXiv – CS AI · Mar 37/104
🧠Researchers demonstrate a technique using steering vectors to suppress evaluation-awareness in large language models, preventing them from adjusting their behavior during safety evaluations. The method makes models act as they would during actual deployment rather than performing differently when they detect they're being tested.
AINeutralarXiv – CS AI · 1d ago6/10
🧠Researchers demonstrate that symbolic reasoning frameworks (I-Ching, Tarot) injected as prompts into language models deployed as strategic agents significantly reshape multi-agent game outcomes by modulating risk-aversion behaviors, producing framework-specific winner distributions in a 7-player diplomacy simulation without the agents following the frameworks' literal content.
AINeutralarXiv – CS AI · 1d ago6/10
🧠Researchers analyzed how Large Language Models behave in repeated game scenarios, finding that LLMs become more cooperative as financial stakes increase—contrary to evolutionary game theory predictions. The study reveals that alignment training and human reasoning patterns embedded in LLM training data override expected selfish behavior, with implications for designing multi-agent AI systems in high-stakes environments.
AINeutralarXiv – CS AI · 1d ago6/10
🧠Researchers demonstrate that general-purpose persona steering vectors can reduce AI model sycophancy (agreement with incorrect users) nearly as effectively as specialized steering methods, while maintaining accuracy on correct statements. This challenges the assumption that sycophancy requires targeted mitigation and suggests it operates as a persona-level property rather than a single manipulable direction.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers demonstrate that large language models systematically overestimate their capabilities and fail to recognize their limitations. The team proposes Capability Self-Assessment (CSA), a reinforcement learning-based approach that teaches models to accurately evaluate their competence and delegate tasks appropriately, while preserving original functionality.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduced GAIATrace, a token-level trace dataset documenting how state-of-the-art agentic AI systems (MiroThinker and OWL) execute general tasks, alongside Vidur-Agent, a simulator enabling reproducible system evaluation. This work addresses the black-box nature of agentic AI by providing unprecedented visibility into reasoning processes and system-level behavior.
AINeutralarXiv – CS AI · Jun 16/10
🧠Researchers used AlphaEvolve to compare strategic behavior between humans and Large Language Models in game theory scenarios, discovering that frontier LLMs demonstrate more sophisticated strategic thinking than humans in iterated rock-paper-scissors. This finding highlights critical differences in how AI systems and humans approach strategic decision-making, with implications for deploying LLMs in competitive and social contexts.
AINeutralarXiv – CS AI · May 126/10
🧠Researchers prove that primacy effects, anchoring, and order-dependence are mathematically inevitable in autoregressive language models due to causal masking constraints. The findings are validated across 12 frontier LLMs and confirmed through human experiments, suggesting cognitive biases represent resource-rational responses to sequential processing rather than design flaws.
$BIC
AINeutralarXiv – CS AI · May 116/10
🧠Researchers investigate how large language models solve compositional tasks, revealing that LLMs employ two distinct mechanisms—compositional and direct—rather than consistently breaking problems into intermediate steps. The study demonstrates that embedding space geometry determines which mechanism dominates, with direct solving more prevalent when tasks align with translation patterns in embedding spaces.
AINeutralarXiv – CS AI · May 46/10
🧠Researchers compared how large language models, humans, and algorithms approach the exploration-exploitation tradeoff in multi-armed bandit decision-making tasks. The study finds that enabling thinking processes in LLMs makes them behave more like humans in simple environments, but LLMs fail to match human adaptability in complex, non-stationary settings despite similar regret outcomes.
AINeutralarXiv – CS AI · Mar 27/1018
🧠Researchers analyzed how large language models express moral judgments when prompted to role-play different personas. The study found that Claude models are most morally robust, while larger models within families tend to be more susceptible to moral shifts through persona conditioning.
