#evolution-strategies News & Analysis

4 articles tagged with #evolution-strategies. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles

AIBullisharXiv – CS AI · May 297/10

🧠

Overcoming Forgetting in LLM Fine-Tuning with Evolution Strategies

Researchers demonstrate that Evolution Strategies (ES) can effectively fine-tune large language models without catastrophic forgetting of prior tasks, contrary to recent concerns. By introducing Anchored Weight Decay (AWD), a regularization technique that constrains optimization toward initial parameters, the work shows ES-based continual learning is viable and computationally efficient compared to reinforcement learning approaches.

AIBullisharXiv – CS AI · May 117/10

🧠

ESSAM: A Novel Competitive Evolution Strategies Approach to Reinforcement Learning for Memory Efficient LLMs Fine-Tuning

Researchers propose ESSAM, a novel training framework combining Evolution Strategies with Sharpness-Aware Maximization to fine-tune large language models for mathematical reasoning while dramatically reducing GPU memory requirements. The approach achieves comparable accuracy to reinforcement learning methods like PPO and GRPO while using 18-10× less memory, addressing a critical bottleneck in LLM development.

AIBullishOpenAI News · Mar 247/104

🧠

Evolution strategies as a scalable alternative to reinforcement learning

Researchers have found that evolution strategies (ES), a decades-old optimization technique, can match the performance of modern reinforcement learning methods on standard benchmarks like Atari and MuJoCo. This discovery suggests ES could serve as a more scalable alternative to traditional RL approaches while avoiding many of RL's practical limitations.

AIBullisharXiv – CS AI · Jun 16/10

🧠

Gradient-Free Training of Spiking Neural Networks via Low-Rank Evolution Strategies

Researchers introduce EGGROLL, a low-rank factorization technique that enables gradient-free training of Spiking Neural Networks (SNNs) using Evolution Strategies, reducing computational overhead by 2.23x while maintaining 79.21% accuracy on N-MNIST. This breakthrough addresses the long-standing challenge of training SNNs on neuromorphic hardware without requiring backpropagation infrastructure.