AINeutralarXiv – CS AI · Jun 17/10
🧠Researchers demonstrate that large language models trained to produce dishonest outputs develop clear, detectable internal representations of deception across multiple architectures. Using linear probes on transformer models, the study achieves near-perfect accuracy in identifying synthetic dishonesty, with implications for AI safety monitoring and the feasibility of detecting deceptive alignment in advanced language models.
🧠 Llama
AINeutralarXiv – CS AI · Mar 117/10
🧠Research analyzes FP4 quantization sensitivity across different layers in large language models using NVFP4 and MXFP4 formats on Qwen2.5 models. The study finds MLP projection layers are most sensitive to quantization, while attention layers show substantial robustness to FP4 precision reduction.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers demonstrate that persistent homology—a topological data analysis technique—can detect and classify ill-posed questions (ambiguous, underspecified, or contradictory queries) in large language models by analyzing hidden state geometry across transformer layers. The method achieves 78-88% accuracy on benchmark datasets and enables targeted activation steering to improve response quality, offering a principled approach to handling inherently problematic inputs.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers introduce MLLM-Microscope, a novel analytical system that examines the internal representations of multimodal large language models (MLLMs) by measuring linearity, intrinsic dimension, and anisotropy across transformer layers. Testing on LLaVA-NeXT and OmniFusion reveals that modality fusion approaches significantly influence how embeddings behave within the model architecture, with OmniFusion demonstrating more consistent dimensional properties across layers.
AINeutralarXiv – CS AI · May 286/10
🧠Researchers discovered that large language models develop geometric structures in their internal representations that mirror human perceptual organization across domains like color, pitch, and emotion, despite training only on text. These perceptual geometries emerge transiently in intermediate layers, providing new insight into how LLMs develop human-like conceptual understanding without direct sensory supervision.
AINeutralarXiv – CS AI · May 286/10
🧠Researchers introduce Residualized Sparse Autoencoders (ReSAEs), a new technique that improves how transformer models are analyzed and modified by accounting for information flow across multiple layers. By training autoencoders on residual activations rather than raw activations, ReSAEs reduce redundancy and better preserve model functionality during multi-layer interventions.
AINeutralarXiv – CS AI · May 126/10
🧠Researchers have analyzed how audio-visual large language models (AVLLMs) process cross-modal information, discovering that integrated audio-visual data concentrates in specialized 'sink tokens' rather than distributing uniformly. This finding enables a training-free method to reduce hallucinations by leveraging these cross-modal information hubs.
AINeutralarXiv – CS AI · May 96/10
🧠Researchers introduce HyperLens, a high-resolution analysis tool that measures cognitive effort in large language models by tracking confidence trajectories across transformer layers. The study reveals that complex tasks consistently require higher cognitive effort and identifies how standard fine-tuning can paradoxically reduce model performance by decreasing necessary cognitive investment.
