#surrogate-gradients News & Analysis

2 articles tagged with #surrogate-gradients. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBullisharXiv – CS AI · May 287/10

🧠

Advancing Direct Training for Spiking Neural Networks with Circulate-Firing Neurons and Learnable Gradients

Researchers propose a novel direct training algorithm for Spiking Neural Networks that addresses performance gaps with traditional ANNs through circulate-firing neurons, learnable surrogate gradients, and balanced loss functions. The method demonstrates competitive results across datasets and extends effectively to Transformer architectures, potentially advancing energy-efficient neural network applications.

AINeutralarXiv – CS AI · Jun 236/10

🧠

A Projection-Based Surrogate Gradient Interpretation for Neural Codec Wrappers

Researchers propose a new interpretation of surrogate gradients for training neural codec wrappers, showing that the SCALED method can be understood as a first-order approximation of video codecs. The technique enables end-to-end learning of pre- and post-processing networks alongside conventional codecs, achieving significant compression improvements of up to 23.59% BD-Rate reduction on x264.