AINeutralarXiv – CS AI · 10h ago6/10
🧠
Communication Dynamics Neural Networks: FFT-Diagonalized Layers for Improved Hessian Conditioning at Reduced Parameter Count
Researchers introduce CDLinear, a neural network layer based on the Communication Dynamics framework that achieves 3.8× parameter reduction compared to dense layers while maintaining comparable accuracy. The layer uses block-circulant matrices with FFT-diagonalization to dramatically improve Hessian conditioning, reducing the condition number by 310× in empirical tests.
$MATIC