y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#interpretability News & Analysis

318 articles tagged with #interpretability. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

318 articles
AIBullisharXiv – CS AI · May 286/10
🧠

Bayesian Gated Non-Negative Contrastive Learning

Researchers propose BayesNCL, a new machine learning approach that improves the interpretability of self-supervised learning models by using probabilistic gating to filter out task-irrelevant features. The method achieves a 142.1% improvement in semantic consistency on ImageNet-100 while maintaining downstream task performance, addressing a fundamental limitation in how contrastive learning models process information.

AINeutralarXiv – CS AI · May 286/10
🧠

Sense Representations Are Inducible Interfaces

Researchers introduce ACROS, a method that adds explicit sense representations (per-token meaning decompositions) to frozen pretrained language models without retraining. The technique achieves competitive results in word-sense disambiguation, lexical steering, and cross-lingual adaptation, positioning sense representations as a practical interface for existing models.

AINeutralarXiv – CS AI · May 286/10
🧠

Guaranteed Optimal Compositional Explanations for Neurons

Researchers introduce the first framework for computing mathematically optimal compositional explanations of neural network neurons, replacing heuristic beam search methods that lack optimality guarantees. The work reveals that 10-40% of explanations previously generated by standard approaches are suboptimal when handling overlapping concepts, while proposing algorithms achieving comparable computational efficiency.

AINeutralarXiv – CS AI · May 286/10
🧠

The Grammar of Transformers: A Systematic Review of Interpretability Research on Syntactic Knowledge in Language Models

A comprehensive systematic review of 337 studies examines how Transformer-based language models encode syntactic knowledge, finding strong performance on formal syntax but variable results at the syntax-semantics interface. The research reveals that while these models demonstrate non-trivial syntactic abilities through behavioral and mechanistic evidence, understanding the detailed computational mechanisms remains limited due to methodological heterogeneity and heavy concentration on English and BERT-like architectures.

AINeutralarXiv – CS AI · May 276/10
🧠

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation

Researchers introduce CUDAnalyst, a new analysis framework that reveals how large language models make planning decisions when generating CUDA kernels by decomposing feedback signals. The study demonstrates that explicit planning helps only when feedback is well-aligned and that effective planning emerges from structured multi-feedback interactions, with findings showing robustness across different models and workloads.

AINeutralarXiv – CS AI · May 276/10
🧠

From Norms to Indicators (N2I-RAG): An Agentic Retrieval-Augmented Generation Framework for Legal Indicator Computation

Researchers introduce N2I-RAG, an AI framework that automates computation of legal indicators from normative texts using retrieval-augmented generation with built-in validation mechanisms. The system addresses hallucination risks in traditional language models by emphasizing traceability and evidence grounding, demonstrating strong performance on French marine environmental law.

AINeutralarXiv – CS AI · May 276/10
🧠

BioFact-MoE: Biologically Factorized Mixture of Experts for Vision-Language Prognostic Modeling in Hepatocellular Carcinoma

Researchers have developed BioFact-MoE, a machine learning framework that uses specialized expert networks to separately analyze liver and tumor factors in hepatocellular carcinoma prognosis. The model achieves superior survival prediction accuracy (75%+ AUC at 12-18 months) while providing interpretable biological insights into treatment heterogeneity.

AINeutralarXiv – CS AI · May 275/10
🧠

Uniboost: Global Coordination with Value Alignment for Fair and Efficient Traffic Allocation

Uniboost is a new traffic allocation framework for recommendation systems that uses posterior value alignment and linear boosting to improve interpretability and efficiency in allocating traffic across business objectives. The system reduces score inflation and decouples allocation plans, demonstrating improved performance in online A/B tests with practical applications for large-scale industrial recommendation systems.

🏢 Meta
AINeutralarXiv – CS AI · May 276/10
🧠

SL-BiLEM: Structured Learnable Behavior-in-the-Loop Epidemic Modeling for Forecasting and Policy Evaluation

Researchers introduce SL-BiLEM, a machine learning framework that improves epidemic forecasting by accounting for how human behavior changes in response to disease spread and policy interventions. The model uses physical constraints to maintain accuracy even when facing novel policy scenarios, demonstrating 76% improvement over existing neural baselines and potential applications for public health decision-making.

AINeutralarXiv – CS AI · May 276/10
🧠

EEG-FM-Audit: A Systematic Evaluation and Analysis Pipeline for EEG Foundation Models

Researchers introduce EEG-FM-Audit, a comprehensive evaluation framework for EEG Foundation Models that reveals properly-tuned supervised baselines can match or exceed state-of-the-art FMs with significantly fewer parameters. The study demonstrates that learning paradigm effectiveness depends heavily on dataset scale and architecture, while introducing neurophysiological probing to improve model interpretability.

🏢 Meta
AINeutralarXiv – CS AI · May 276/10
🧠

Recon: Reconstruction-Guided Reasoning Synthesis for User Modeling

Researchers introduce Recon, a method for improving user modeling by evaluating synthesized reasoning traces through action reconstruction rather than post-hoc rationalization. The approach achieves 54.7% win rates over baseline methods and demonstrates that reasoning should naturally elicit predicted actions from context, advancing AI's ability to simulate human behavior.

AINeutralarXiv – CS AI · May 276/10
🧠

Two Speeds of Learning: A Representation-Readout Decomposition of Grokking and Double Descent

Researchers propose a representation-readout decomposition framework that explains anomalous neural network training phenomena like grokking and double descent by analyzing two competing learning processes: representation learning in encoders and readout calibration in classifiers. The framework provides task-agnostic diagnostics that reveal these phenomena stem from fluctuations in relative learning speeds rather than mysterious delays, challenging existing lazy-to-rich learning theories.

AINeutralarXiv – CS AI · May 276/10
🧠

How Chain-of-Thought Works? Tracing Information Flow from Decoding, Projection, and Activation

Researchers have developed a mechanistic interpretability framework that reverses information flow through Chain-of-Thought prompting to understand how AI models reason. The study reveals CoT functions as a decoding space pruner that uses answer templates to guide outputs, with task-dependent neuron modulation that reduces activation in open-domain tasks but increases it in closed-domain scenarios.

AINeutralarXiv – CS AI · May 276/10
🧠

Genre Controlled Music Generation via Activation Steering

Researchers present a novel method for controlling music generation in the MusicGen transformer by using activation steering techniques applied at inference time. The approach enables precise genre control through linear probes that manipulate the model's residual stream, demonstrating how interpretable AI behaviors can enhance collaborative music creation.

AINeutralarXiv – CS AI · May 276/10
🧠

Real-Time Progress Prediction in Reasoning Language Models

Researchers have developed methods to predict real-time progress in reasoning language models with long chains of thought, achieving a 0.161 MAE on mathematical tasks. The work addresses the opacity problem in extended reasoning by training linear probes on hidden states and fine-tuning models to generate percentage-based progress estimates, while quantifying the inherent ambiguity in progress labeling across different model sizes.

AIBullisharXiv – CS AI · May 276/10
🧠

Explainable Cross-Disease Reasoning for Cardiovascular Risk Assessment from Low-Dose Computed Tomography

Researchers have developed an explainable AI framework that jointly assesses lung and cardiovascular health from low-dose chest CT scans by modeling cross-disease physiological interactions. The system achieves 91.9% AUC for cardiovascular disease screening and outperforms cardiac-specific baselines by explicitly reasoning through pulmonary findings to inform heart risk predictions.

AINeutralarXiv – CS AI · May 276/10
🧠

Beyond Transfer Accuracy: Faithful Circuits for Controlled Low-Resource Adaptation

Researchers introduce a counterfactual-free circuit discovery method adapted for unstructured natural text, enabling Circuit-Targeted Supervised Fine-Tuning (CT-SFT) that improves low-resource model adaptation while preserving performance on source tasks and preventing catastrophic forgetting.

AIBullisharXiv – CS AI · May 276/10
🧠

ECSEL: Explainable Classification via Signomial Equation Learning

Researchers introduced ECSEL, an explainable classification method that learns symbolic equations to create interpretable machine learning models. The approach outperforms competing symbolic regression methods on benchmarks while maintaining computational efficiency and classification accuracy comparable to traditional ML models.

AINeutralarXiv – CS AI · May 276/10
🧠

Vital Trace: Protocol-Constrained Patient-State Reasoning for Longitudinal Clinical Trajectories

Researchers present Vital Trace, a protocol-constrained multi-agent AI framework designed to improve clinical risk prediction in intensive care units by tracking patient trajectories over extended periods. The system uses compact patient-state memory and structured reasoning agents rather than unbounded text histories, demonstrating better temporal consistency and interpretability on MIMIC-IV and eICU datasets.

AINeutralarXiv – CS AI · May 276/10
🧠

AMARIS: A Memory-Augmented Rubric Improvement System for Rubric-Based Reinforcement Learning

AMARIS is a new system that improves how large language models are trained using reinforcement learning by maintaining a persistent memory of past training data and failures. Unlike existing methods that only look at immediate, local information, AMARIS tracks recurring problems and previous rubric adjustments over time, achieving measurable performance improvements across multiple domains.

AINeutralarXiv – CS AI · May 126/10
🧠

OracleTSC: Oracle-Informed Reward Hurdle and Uncertainty Regularization for Traffic Signal Control

Researchers introduce OracleTSC, an LLM-based traffic signal control system that combines reward hurdle mechanisms and uncertainty regularization to stabilize reinforcement learning training. The approach achieves 75% reduction in travel time while maintaining interpretability through natural language explanations, with strong cross-intersection generalization capabilities.

AINeutralarXiv – CS AI · May 125/10
🧠

Reconciling Consistency-Based Diagnosis with Actual-Causality-Based Explanations

Researchers establish connections between Consistency-Based Diagnosis (CBD) and Actual Causality frameworks within Explainable AI (XAI), addressing a gap in how diagnosis systems explain their outputs. This theoretical work bridges two previously disconnected areas in AI research, with potential applications for making data management systems more interpretable and trustworthy.

AINeutralarXiv – CS AI · May 126/10
🧠

Emergent Semantic Role Understanding in Language Models

Researchers demonstrate that language models develop semantic role understanding (who-did-what-to-whom comprehension) primarily during pre-training, though fine-tuning still improves performance. Using linear probes on frozen transformer models, they find semantic role information emerges from language modeling objectives alone, with representation structure becoming more distributed as models scale.

AINeutralarXiv – CS AI · May 126/10
🧠

Explainable Knowledge Tracing via Probabilistic Embeddings and Pattern-based Reasoning

Researchers introduce Probabilistic Logical Knowledge Tracing (PLKT), an interpretable AI framework that uses Beta-distributed probabilistic embeddings to model student knowledge states and predict learning performance. Unlike conventional deep learning approaches that rely on opaque deterministic embeddings, PLKT constructs transparent reasoning paths showing how past interactions influence predictions while maintaining superior accuracy compared to existing methods.

AINeutralarXiv – CS AI · May 126/10
🧠

Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning

Researchers introduce MarsTSC, a novel framework combining Vision Language Models with agentic reasoning for few-shot multimodal time series classification. The system uses collaborative AI roles—Generator, Reflector, and Modifier—to iteratively refine knowledge and improve classification accuracy across 12 benchmarks while providing interpretable explanations.

← PrevPage 9 of 13Next →