AIBullisharXiv – CS AI · Feb 276/104
🧠Researchers decoded the internal representations of scGPT, a single-cell foundation model, revealing it organizes genes into interpretable biological coordinate systems rather than opaque features. The model encodes cellular organization patterns including protein localization, interaction networks, and regulatory relationships across its transformer layers.
AIBullisharXiv – CS AI · Feb 276/106
🧠Researchers introduce Temporal Sparse Autoencoders (T-SAEs), a new method that improves AI model interpretability by incorporating temporal structure of language through contrastive loss. The technique enables better separation of semantic from syntactic features and recovers smoother, more coherent semantic concepts without sacrificing reconstruction quality.
AINeutralGoogle DeepMind Blog · Dec 166/105
🧠Google has released Gemma Scope 2, providing open interpretability tools for understanding the behavior of language models across the entire Gemma 3 family. These tools are designed to help the AI safety community analyze and interpret complex language model behaviors.
AIBullishOpenAI News · Nov 136/107
🧠OpenAI is researching mechanistic interpretability through sparse neural network models to better understand AI reasoning processes. This approach aims to make AI systems more transparent and improve their safety and reliability.
AIBullishHugging Face Blog · Jul 316/106
🧠Google has released Gemma 2 2B, a smaller 2-billion parameter version of its open-source AI model, alongside ShieldGemma for safety filtering and Gemma Scope for model interpretability. These releases expand Google's Gemma family with more accessible and transparent AI tools for developers and researchers.
AIBullishOpenAI News · Apr 146/105
🧠OpenAI has launched Microscope, a visualization tool that provides detailed views of layers and neurons in eight vision AI models commonly used in interpretability research. The tool aims to help researchers better understand and analyze the internal features that develop within neural networks.
AINeutralarXiv – CS AI · Mar 174/10
🧠Researchers have developed SyMPLER, an explainable AI model for time series forecasting that uses dynamic piecewise-linear approximations to handle nonstationary environments. The model automatically determines when to add new local models based on prediction errors using Statistical Learning Theory, achieving comparable performance to black-box models while maintaining interpretability.
AINeutralarXiv – CS AI · Mar 175/10
🧠Researchers introduce Jacobian Scopes, a new gradient-based method for interpreting how individual tokens influence Large Language Model predictions. The technique uses perturbation theory and information geometry to reveal model biases, translation strategies, and learning mechanisms, with open-source implementations and an interactive demo available.
🏢 Hugging Face
AINeutralarXiv – CS AI · Mar 54/10
🧠Researchers introduced StructLens, a new analytical framework that uses maximum spanning trees to reveal global structural relationships between layers in language models, going beyond existing local token analysis methods. The approach shows different similarity patterns compared to traditional cosine similarity and proves effective for practical applications like layer pruning.
AINeutralarXiv – CS AI · Mar 54/10
🧠Researchers introduce PatchDecomp, a new neural network method for time series forecasting that achieves high accuracy while providing interpretable explanations. The method divides time series into patches and shows how each patch contributes to predictions, offering both quantitative and visual insights into forecasting decisions.
AINeutralarXiv – CS AI · Mar 54/10
🧠Researchers developed TPK, a trajectory prediction system for autonomous vehicles that integrates prior knowledge to make predictions more trustworthy and physically feasible. The system incorporates interaction and kinematic models for vehicles, pedestrians, and cyclists, improving interpretability while ensuring predictions adhere to physics.
AINeutralarXiv – CS AI · Mar 54/10
🧠Researchers introduce WeightLens and CircuitLens, two new methods for analyzing neural network interpretability that go beyond traditional activation-based approaches. These tools aim to provide more systematic and scalable analysis of neural network circuits by interpreting features directly from weights and capturing feature interactions.
AINeutralarXiv – CS AI · Mar 34/104
🧠Researchers have developed a new Explainable AI method that makes Wasserstein distances more interpretable by attributing distance calculations to specific data components like subgroups and features. The framework enables better analysis of dataset shifts and transport phenomena across diverse applications with high accuracy.
AINeutralarXiv – CS AI · Mar 34/105
🧠Researchers analyzed how Large Language Models access semantic memory using the Semantic Fluency Task, finding that LLMs exhibit similar memory foraging patterns to humans. The study reveals convergent and divergent search strategies in LLMs that mirror human cognitive behavior, potentially enabling better human-AI alignment or productive cognitive disalignment.
AINeutralarXiv – CS AI · Mar 34/107
🧠Researchers successfully applied a Concept Induction framework for neural network interpretability to the SUN2012 dataset, demonstrating the method's broader applicability beyond the original ADE20K dataset. The study assigns interpretable semantic labels to hidden neurons in CNNs and validates them through statistical testing and web-sourced images.
AINeutralarXiv – CS AI · Mar 24/107
🧠Researchers analyzed DINOv2 vision transformer using Sparse Autoencoders to understand how it processes visual information, discovering that the model uses specialized concept dictionaries for different tasks like classification and segmentation. They propose the Minkowski Representation Hypothesis as a new framework for understanding how vision transformers combine conceptual archetypes to form representations.
