AIBullisharXiv – CS AI · Jun 237/10
🧠Researchers introduce GyroSwin, a neural surrogate model that simulates 5D gyrokinetic plasma turbulence with 1000x computational efficiency while capturing nonlinear physics effects. This breakthrough combines hierarchical Vision Transformers with cross-attention mechanisms to predict turbulent heat transport more accurately than traditional reduced-order models, advancing nuclear fusion energy research.
AIBullisharXiv – CS AI · Jun 107/10
🧠Researchers introduce NuWa, a novel model compression technique that derives lightweight, class-specific Vision Transformers optimized for edge devices. By identifying and removing class-detrimental weights through self-knowledge purification, NuWa achieves up to 29% accuracy improvements on specialized tasks while reducing pruning costs by 99.83% compared to existing methods.
AINeutralarXiv – CS AI · Jun 97/10
🧠Researchers present SENTRY, a statistical fault injection framework that efficiently evaluates Vision Transformers' reliability against soft errors in safety-critical applications. The method achieves formal reliability guarantees using finite-population sampling theory, reducing experimental costs by up to 10,700x while identifying critical vulnerabilities in normalization layers and IEEE-754 exponent bits.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers introduce RAPID, a depth-aware token reduction framework for Vision Transformers that uses different pruning and merging strategies across network layers to reduce computational costs while maintaining accuracy. The method achieves superior performance compared to existing approaches like ToMe, with up to 4.29% higher accuracy in aggressive compression scenarios.
AIBullisharXiv – CS AI · Jun 97/10
🧠Researchers introduce I-Segmenter, the first fully integer-only Vision Transformer framework for semantic segmentation that eliminates floating-point operations to enable efficient deployment on resource-constrained devices. The model achieves only 5.1% accuracy loss compared to standard floating-point versions while reducing model size by 3.8x and improving inference speed by 1.2x, with a novel activation function addressing quantization challenges.
AIBullisharXiv – CS AI · Jun 87/10
🧠Researchers introduce ViSAE, a mechanistic interpretability toolbox that uses neuroscience-inspired principles to decode how Vision Transformers make decisions through human-interpretable concept circuits. The method achieves significant improvements in model auditing and steering, with concept editing improving worst-group accuracy by 48.2% on benchmark tests, addressing critical safety concerns before ViT deployment.
AIBullisharXiv – CS AI · Jun 27/10
🧠Researchers introduce STARFISH, a novel neural network healing method that efficiently recovers accuracy lost during weight pruning by aligning pruned networks with original internal state representations using minimal unlabeled calibration data. The technique achieves up to 22% accuracy improvement over existing methods and recovers 82% of original performance after removing 75% of weights from vision transformers.
AIBullisharXiv – CS AI · May 277/10
🧠Researchers introduce JetViT, a hybrid Vision Transformer architecture that maintains accuracy of state-of-the-art models while delivering up to 1.79x faster throughput and 44.81% lower latency on high-resolution images. The innovation uses post-training attention search to convert full-attention models into efficient hybrid variants by strategically replacing redundant attention blocks.
🏢 Nvidia
AIBullisharXiv – CS AI · May 97/10
🧠Researchers introduce ViTok-v2, a 5-billion-parameter Vision Transformer autoencoder that achieves native resolution support and stable scaling without adversarial losses. The breakthrough advances image tokenization for generative AI by improving reconstruction quality across multiple resolutions while maintaining generation capabilities.
AIBullisharXiv – CS AI · Apr 157/10
🧠Researchers introduce Criticality-Aware Adversarial Training (CAAT), a parameter-efficient method that identifies and fine-tunes only the most robustness-critical parameters in Vision Transformers, achieving 94.3% of standard adversarial training robustness while tuning just 6% of model parameters. This breakthrough addresses the computational bottleneck preventing large-scale adversarial training deployment.
AIBullisharXiv – CS AI · Apr 137/10
🧠Researchers introduce Ge²mS-T, a novel Spiking Vision Transformer architecture that optimizes energy efficiency while maintaining training and inference performance through multi-dimensional grouped computation. The approach addresses fundamental limitations in existing SNN paradigms by balancing memory overhead, learning capability, and energy consumption simultaneously.
AIBullisharXiv – CS AI · Apr 77/10
🧠Researchers have developed a zero-shot quantization method that transfers robustness between AI models through weight-space arithmetic, improving post-training quantization performance by up to 60% without requiring additional training. This breakthrough enables low-cost deployment of extremely low-bit models by extracting 'quantization vectors' from donor models to patch receiver models.
AIBullisharXiv – CS AI · Mar 46/103
🧠Researchers introduce SiNGER, a new knowledge distillation framework for Vision Transformers that suppresses harmful high-norm artifacts while preserving informative signals. The technique uses nullspace-guided perturbation and LoRA-based adapters to achieve state-of-the-art performance in downstream tasks.
AIBullisharXiv – CS AI · Feb 277/106
🧠Researchers developed ViT-Linearizer, a distillation framework that transfers Vision Transformer knowledge into linear-time models, addressing quadratic complexity issues for high-resolution inputs. The method achieves 84.3% ImageNet accuracy while providing significant speedups, bridging the gap between efficient RNN-based architectures and transformer performance.
AIBullisharXiv – CS AI · Jun 256/10
🧠Researchers introduce HiReLC, a hierarchical reinforcement learning framework that automates the joint compression of neural networks through pruning and quantization. The system achieves 5.99-6.72x compression ratios across Vision Transformers and CNNs with minimal accuracy loss, using a two-level agent architecture guided by Fisher Information sensitivity estimates.
AIBullisharXiv – CS AI · Jun 236/10
🧠Researchers introduce ScalePredictor, a dynamic quantization framework that optimizes Vision Transformer deployment on edge devices by learning instance-aware quantization scales. The method leverages correlations between shallow-layer activation distributions and deeper-layer optimal scales, achieving superior accuracy-efficiency trade-offs compared to existing post-training quantization approaches.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers introduce HyperAdapter, a parameter-efficient fine-tuning method for vision transformers that adapts model weights through hypergraph-structured token groupings rather than individual tokens. The approach demonstrates consistent performance improvements over existing adapter methods while maintaining computational efficiency, suggesting that adaptation space design is critical for vision transformer transfer learning.
AINeutralarXiv – CS AI · Jun 116/10
🧠Researchers introduce LASA, a weak supervision method for open-vocabulary sketch semantic segmentation that aggregates multi-layer Vision Transformer attention maps to capture complementary spatial cues. The approach achieves significant improvements over baselines without requiring pixel-level annotations, advancing computer vision capabilities for sparse line drawing interpretation.
AINeutralarXiv – CS AI · Jun 116/10
🧠Researchers demonstrate a parameter-efficient fine-tuning approach for the Prithvi-EO geospatial foundation model to improve fallow land detection, achieving a 25.70% improvement over baseline methods. The hybrid approach combines LoRA adaptation with ViT-Adapter neck designs to address the challenge of multi-scale feature extraction from Vision Transformer architectures for agricultural monitoring.
AINeutralarXiv – CS AI · Jun 96/10
🧠Researchers conducted a mechanistic analysis of adversarial fine-tuning in Vision Transformers, examining how training on corrupted images affects model robustness. The study reveals that while adversarial training improves performance on seen corruption types, these gains don't generalize to unseen perturbations, and the underlying sparse representations remain fundamentally unchanged despite observable shifts in attention mechanisms.
AIBullisharXiv – CS AI · Jun 96/10
🧠Researchers demonstrate that self-supervised Vision Transformers, particularly the DINO family, can effectively detect temporomandibular joint osteoarthritis from cone-beam CT scans with 90.2% AUC when partially adapted. The study shows that strategic backbone unfreezing of final transformer blocks outperforms fully frozen models and supervised baselines, providing practical guidance for deploying foundation models in medical imaging with limited training data.
AINeutralarXiv – CS AI · Jun 46/10
🧠Researchers introduce MaskAQ, a novel data-free quantization technique for Vision Transformers that identifies and aligns informative image regions to improve model compression without requiring access to real training data. The approach addresses distribution mismatches in synthetic data generation, enabling more efficient deployment of ViT models while maintaining security and privacy.
AINeutralarXiv – CS AI · Jun 25/10
🧠Researchers propose Belief2-Attention, an advancement of the Belief-Attention mechanism that improves transformer performance in vision tasks by utilizing both perpendicular and projected components during orthogonal projection, while introducing an additional inner-product matrix to capture richer token correlations than standard attention mechanisms.
$QK$ZZ
AINeutralarXiv – CS AI · May 296/10
🧠Researchers introduce a neuron-centric model fusion algorithm that combines independently trained neural networks without retraining by matching intermediate representations and using neuron attribution scores. The method outperforms existing approaches in zero-shot and non-IID scenarios across multiple architectures including VGGs, ResNets, and Vision Transformers.
AINeutralarXiv – CS AI · May 286/10
🧠AdaMerge introduces a training-free method to accelerate Vision Transformers by improving token merging through salience-aware mechanisms and adaptive layer-wise compression. The approach outperforms existing token reduction methods across all computational efficiency benchmarks, maintaining superior accuracy-to-FLOPs ratios on ImageNet-1k evaluations.
