y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#adam News & Analysis

2 articles tagged with #adam. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AINeutralarXiv – CS AI · Jun 116/10
🧠

A Physics-Inspired Optimizer: Velocity Regularized Adam

Researchers introduce Velocity-Regularized Adam (VRAdam), a physics-inspired optimizer that improves deep neural network training by adding velocity-based regularization to prevent oscillations and instability. VRAdam demonstrates superior performance compared to standard optimizers like AdamW across multiple benchmarks including image classification, language modeling, and generative modeling tasks.

AIBullisharXiv – CS AI · Mar 37/107
🧠

MuonRec: Shifting the Optimizer Paradigm Beyond Adam in Scalable Generative Recommendation

Researchers introduce MuonRec, a new optimization framework for recommendation systems that significantly outperforms the widely-used Adam/AdamW optimizers. The framework reduces training steps by 32.4% on average while improving ranking quality by 12.6% in NDCG@10 metrics across traditional and generative recommenders.