AINeutralarXiv – CS AI · 6h ago6/10
🧠
Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) for Exponential Compression of Deep Neural Networks
Researchers introduce Automatically Differentiable Nonlinear Tensor Networks (ADNTNs), a novel technique for compressing deep neural networks by building large weight tensors from hierarchical small cores with nonlinear activations. The method achieves compression ratios from 2,000× to 77,000× on standard architectures like AlexNet and VGG-16 while maintaining or improving accuracy, representing a mathematically structured approach to reducing model size.