#neural-network-pruning News & Analysis

5 articles tagged with #neural-network-pruning. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

5 articles

AIBullisharXiv – CS AI · Jun 27/10

🧠

STARFISH: faST Accuracy Recovery in pruned networks From Internal State Healing

Researchers introduce STARFISH, a novel neural network healing method that efficiently recovers accuracy lost during weight pruning by aligning pruned networks with original internal state representations using minimal unlabeled calibration data. The technique achieves up to 22% accuracy improvement over existing methods and recovers 82% of original performance after removing 75% of weights from vision transformers.

AINeutralarXiv – CS AI · Jun 116/10

🧠

TAPIOCA: Why Task- Aware Pruning Improves OOD model Capability

Researchers demonstrate that task-aware layer pruning improves model performance on out-of-distribution (OOD) data while providing no benefits for in-distribution data. The improvement occurs because pruning removes layers that distort the task-adapted geometric representation, realigning OOD inputs with the model's learned task geometry.

AINeutralarXiv – CS AI · Jun 96/10

🧠

Structured Neuron Pruning in Deep Neural Networks Using Multi-Armed Bandits

Researchers present a novel structured pruning framework that uses multi-armed bandit algorithms to remove redundant neurons from deep neural networks. The approach treats each neuron as a bandit arm, testing its importance through temporary masking and loss measurement, then applies various MAB policies (UCB1, Thompson Sampling, etc.) to identify which neurons to prune. Experiments across tabular and deep learning tasks show MAB-based pruning significantly outperforms traditional magnitude-based and greedy pruning methods.

AINeutralarXiv – CS AI · Jun 96/10

🧠

Hyperflux: Pruning Reveals Importance

Researchers introduce Hyperflux, a novel L0 pruning method that models neural network pruning as a dynamically evolving system driven by flux and pressure mechanisms. The approach provides interpretability at multiple scales while achieving competitive sparsity results on standard vision benchmarks, advancing understanding of how neural networks can be efficiently compressed.

AINeutralarXiv – CS AI · May 296/10

🧠

An accuracy-aware extension to LRP-based pruning for CNNs to prevent cascading accuracy degradation in data-scarce transfer learning

Researchers propose an accuracy-aware pruning mechanism for CNNs that improves upon existing Layer-wise Relevance Propagation (LRP) methods to reduce model size without degrading performance in transfer learning scenarios with limited data. The approach dynamically adjusts pruning rates using harmonic mean of class accuracy, achieving 15% improvement in compression efficiency while maintaining task-specific accuracy.