AIBullisharXiv โ CS AI ยท 6d ago7/103
๐ง
CSRv2: Unlocking Ultra-Sparse Embeddings
CSRv2 introduces a new training approach for ultra-sparse embeddings that reduces inactive neurons from 80% to 20% while delivering 14% accuracy gains. The method achieves 7x speedup over existing approaches and up to 300x improvements in compute and memory efficiency compared to dense embeddings.