3 articles tagged with #neural-network-compression. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers introduce InfoQuant, a training-free method that optimizes activation distributions for low-bit quantization in large language models by using Peak Suppression Orthogonal Transformation. The technique achieves 97% accuracy preservation under W4A4KV4 quantization and reduces performance degradation by 42% compared to previous methods, advancing efficient LLM deployment.
Researchers introduce Vanishing Contributions (VCON), a unified framework for compressing deep neural networks through gradual parallel execution of original and compressed models. The technique demonstrates 1-15% accuracy improvements across vision and NLP tasks compared to existing compression methods.
Researchers introduce CLASP, a token reduction framework that optimizes Multimodal Large Language Models by intelligently pruning visual tokens through class-adaptive layer fusion and dual-stage pruning. The approach addresses computational inefficiency in MLLMs while maintaining performance across diverse benchmarks and architectures.
