AIBullisharXiv – CS AI · May 277/10
🧠Researchers introduce PaTAS (Parallel Trust Assessment System), a framework that uses Subjective Logic to measure and propagate trust through neural networks alongside standard computation. The system identifies reliability gaps and adversarial vulnerabilities that traditional metrics like accuracy fail to detect, offering a foundation for deploying AI safely in critical applications.
AIBullisharXiv – CS AI · May 277/10
🧠MedVol-R1 introduces a reinforcement learning framework for volumetric reasoning segmentation in 3D medical imaging, decoupling evidence grounding from mask generation to improve interpretability and accuracy. The system uses an LVLM to identify key 2D evidence anchors before propagating them into coherent 3D segmentations, achieving state-of-the-art results on multiple medical imaging benchmarks without requiring expensive annotations.
AIBullisharXiv – CS AI · May 127/10
🧠Researchers present a weakly supervised learning approach that combines neural networks with symbolic AI for object-centric reasoning tasks, requiring only 1% of typical labels while outperforming foundation models in domain generalization. The method bridges perception and logical reasoning by using slot-based architectures and VAEs to ground symbolic outputs for frameworks like Inductive Logic Programming.
AINeutralarXiv – CS AI · May 127/10
🧠Researchers discovered that large language models internally detect their own reasoning errors with 95% accuracy but verbally express unwarranted confidence in flawed outputs. Despite this hidden awareness, four intervention strategies failed to correct the errors, indicating the signal reflects computation quality rather than a mechanism that can be leveraged for improvement.
🧠 Llama
AIBullisharXiv – CS AI · May 127/10
🧠Researchers introduce HA-HeteroGNN, a Graph Neural Network framework that improves both interpretability and efficiency through hierarchical attention mechanisms and relevance-driven pruning. The approach achieves a 27% reduction in graph edges while improving classification accuracy by up to 2.46%, alongside 43.9% training time reductions.
AINeutralarXiv – CS AI · May 127/10
🧠Researchers introduce a controlled-invariance methodology to distinguish whether hallucination detection in large language models actually evaluates reasoning quality or merely exploits surface-level answer cues. Their lightweight TRACT model demonstrates that effective detection relies primarily on lexical trajectory features rather than complex learned representations, suggesting current detection methods conflate endpoint artifacts with genuine reasoning validation.
AINeutralarXiv – CS AI · May 127/10
🧠Researchers demonstrate that sparse autoencoders (SAEs) used to interpret AI model activations face fundamental geometric constraints rather than just resource limitations. By analyzing 844 SAE checkpoints across Gemma 2 models, they show that manifold curvature and intrinsic dimensionality at each layer predict reconstruction performance, establishing a transferable geometric law that explains why SAE effectiveness varies across layers.
AIBullisharXiv – CS AI · May 127/10
🧠Researchers propose using 'persona coordinates'—low-dimensional subspaces derived from contrasting harmful and harmless model behaviors—to improve the generalization of linear probes that monitor language models for deception and harmful outputs. Testing across 10 datasets shows that probes trained on persona-derived directions significantly outperform those trained on raw model activations, addressing a critical gap in AI safety monitoring.
AINeutralarXiv – CS AI · May 127/10
🧠Researchers introduce Data-driven Circuit Discovery (DCD), a new framework for understanding language models that challenges the assumption that models implement tasks using a single computational circuit. By clustering data based on how models process examples, DCD discovers multiple task-specific circuits per dataset, revealing that existing methods conflate distinct mechanisms into single circuits and produce dataset-dependent rather than generalizable interpretations.
AIBullisharXiv – CS AI · May 127/10
🧠Researchers introduce Auto-Rubric as Reward (ARR), a framework that replaces opaque scalar reward signals in multimodal AI alignment with explicit, structured criteria-based evaluation. By externalizing a model's implicit preferences into interpretable rubrics before comparison, ARR reduces evaluation bias and enables more reliable human-preference alignment in generative models.
AIBullisharXiv – CS AI · May 127/10
🧠Researchers apply game-theoretic free energy principles to analyze attention head interactions in large language models, discovering that heads exhibit higher-order redundancy. Their framework enables principled pruning of low-contribution heads, achieving 18% FLOP reduction and 22% throughput improvement in GPT2 with minimal performance degradation.
🏢 Perplexity🧠 Llama
AIBullisharXiv – CS AI · May 117/10
🧠Researchers introduce Behavior Cue Reasoning, a technique that trains large language models to emit special token sequences before specific behaviors, making their reasoning processes more monitorable and controllable. The method enables external oversight systems to prune inefficient reasoning tokens and recover safe actions from otherwise unsafe reasoning traces, achieving up to 96% success rates in constrained environments without sacrificing performance.
AIBullisharXiv – CS AI · May 117/10
🧠Researchers propose SAEgis, a lightweight adversarial attack detection framework using sparse autoencoders (SAEs) to protect vision-language models from adversarial perturbations. The plug-and-play method requires no additional adversarial training and demonstrates strong cross-domain generalization, addressing a critical safety gap in increasingly deployed VLM systems.
AINeutralarXiv – CS AI · May 117/10
🧠Researchers propose a geometric framework for detecting hallucinations in large language models by analyzing embedding space structure, categorizing three types of errors with different detectability profiles. The approach outperforms standard NLI baselines on expert-annotated datasets, providing interpretable diagnostics for production systems operating under black-box constraints.
AIBullisharXiv – CS AI · May 117/10
🧠Researchers discovered that language models encode tool-selection decisions in interpretable linear patterns within their internal activations, enabling both prediction of errors before execution and steering of tool choices at 77-100% accuracy. This finding has implications for making AI agents more reliable and controllable, particularly in high-stakes scenarios where wrong tool selection causes irreversible failures.
🧠 Llama
AIBullisharXiv – CS AI · May 117/10
🧠Researchers introduce MAVEN, a multi-agent framework that enhances large language model reasoning through explicit role-separation and intermediate verification steps. The system outperforms existing approaches on multiple benchmarks by creating verifiable, modular deliberation trajectories rather than relying on implicit reasoning or post-hoc consensus mechanisms.
AINeutralarXiv – CS AI · May 117/10
🧠Researchers have developed a method to predict whether language model reasoning traces produce correct answers by analyzing uncertainty profiles—patterns in model confidence across generated token sequences. The approach achieves 80.7% accuracy in detecting errors and can identify failures within the first few hundred tokens, providing insights into how LLMs actually perform reasoning tasks.
AIBullisharXiv – CS AI · May 97/10
🧠Researchers introduce TACT, a technique using activation steering to detect and correct 'agent drift' in language model coding agents, where models either repeatedly reason over known information or issue tool calls without proper reasoning. The method improves task resolution rates by 4.8-5.8 percentage points across multiple benchmarks while reducing steps needed to complete tasks by up to 26%.
AINeutralarXiv – CS AI · May 97/10
🧠Researchers demonstrate that large language models encode social role granularity—from individual to institutional perspectives—as a structured geometric axis in their internal representations. Using activation steering, they show this axis is causally manipulable, enabling controlled shifts in response scope across different models.
🧠 Llama
AINeutralarXiv – CS AI · May 77/10
🧠Researchers present an automated pipeline for auditing behavioral changes in large language models when interventions are applied. The method generates human-readable hypotheses about model differences and validates them statistically, successfully identifying both intended and unexpected side-effects across real-world interventions like knowledge editing and unlearning.
AIBearisharXiv – CS AI · May 47/10
🧠Researchers have identified critical vulnerabilities in how large language models make strategic decisions under incomplete information, revealing gaps between their internal beliefs and external reasoning. The study demonstrates that LLMs encode more accurate hidden beliefs than they express verbally, but these beliefs are brittle and degrade with multi-hop reasoning, raising significant concerns about deploying LLMs in high-stakes decision-making scenarios without safeguards.
🧠 Llama
AIBullisharXiv – CS AI · May 47/10
🧠Researchers introduce RSAT, a method that trains small language models (1-8B parameters) to answer table-based questions with step-by-step reasoning and cell-level citations, achieving 3.7x improvement in faithfulness over baseline approaches. The technique uses structured JSON outputs and reinforcement learning to ensure AI reasoning is verifiable and grounded in source data.
🧠 Llama
AIBullisharXiv – CS AI · May 17/10
🧠Researchers propose a causally motivated method to reduce biases in reward models used for LLM alignment by identifying and suppressing neurons correlated with spurious features like response length. The technique achieves comparable performance to much larger models while editing less than 2% of neurons, suggesting biases are concentrated in early network layers.
AIBullishMIT Technology Review · Apr 307/10
🧠San Francisco startup Goodfire released Silico, a mechanistic interpretability tool that enables researchers to examine and modify AI model parameters during training, offering unprecedented fine-grained control over large language model development and behavior.
AIBullisharXiv – CS AI · Apr 157/10
🧠Researchers demonstrate that multi-token prediction (MTP) outperforms standard next-token prediction (NTP) for training language models on reasoning tasks like planning and pathfinding. Through theoretical analysis of simplified Transformers, they reveal that MTP enables a reverse reasoning process where models first identify end states then reconstruct paths backward, suggesting MTP induces more interpretable and robust reasoning circuits.
