y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#ptq News & Analysis

2 articles tagged with #ptq. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AIBullisharXiv – CS AI · May 297/10
🧠

Pushing the Limits of Block Rotations in Post-Training Quantization

Researchers present PeRQ, a post-training quantization method that uses permutations to optimize block rotations for neural network compression. The approach recovers up to 90% of full-vector rotation performance when quantizing large language models to INT4, significantly outperforming existing block rotation methods.

🏢 Perplexity🧠 Llama
AINeutralarXiv – CS AI · Jun 96/10
🧠

Understanding Quantization-Aware Training: Gradients at Quantized Weights Bias to the Low-Loss Basin

Researchers propose a geometric framework explaining why post-training quantization (PTQ) fails at aggressive bitwidths while quantization-aware training (QAT) succeeds in recovery. The study reveals that gradients in QAT acquire an inward bias toward low-loss regions, enabling quantized neural networks to maintain accuracy where simpler PTQ methods collapse.