AINeutralarXiv – CS AI · May 96/10
🧠Researchers propose DREE, a novel lifelong learning framework for neural vehicle routing problem solvers that handles continually drifting task patterns with limited training resources per task. The approach addresses a gap in existing methods by managing catastrophic forgetting while learning sequential tasks in real-world logistics scenarios where problem patterns shift over time.
AINeutralarXiv – CS AI · May 76/10
🧠Researchers introduce Memini, a system that applies biological multi-timescale memory dynamics to external memory in large language models. By organizing knowledge as a directed graph where edges follow coupled fast and slow variables inspired by synaptic consolidation, the system enables LLMs to continuously update their knowledge without explicit management, allowing new information to be immediately useful while less relevant associations gradually fade.
AINeutralarXiv – CS AI · May 46/10
🧠Researchers introduce MemoryBench, a new benchmark for evaluating how large language models learn and improve from accumulated user feedback over time. The framework addresses limitations in existing memory benchmarks by testing continual learning across multiple domains and languages, revealing that current state-of-the-art systems perform poorly on these tasks.
AINeutralarXiv – CS AI · May 16/10
🧠Researchers demonstrate that memory-augmented large language model agents face the same continual learning challenges as parametric systems, but shifted to the memory retrieval level rather than parameter updates. The study reveals that memory representation and organization design critically determine whether LLM agents can effectively reuse experiences across sequential tasks without forgetting or suffering negative transfer.
AINeutralarXiv – CS AI · Apr 206/10
🧠Researchers introduce TeLAPA, a continual reinforcement learning framework that maintains diverse policy archives instead of relying on single-model preservation, addressing the loss of plasticity problem where retained policies fail to serve as effective starting points for rapid adaptation across new tasks.
AIBullisharXiv – CS AI · Apr 206/10
🧠Researchers introduce JumpLoRA, a novel framework that uses sparse adapters with JumpReLU gating to enable continual learning in large language models while mitigating catastrophic forgetting. The method dynamically isolates parameters across tasks, outperforming existing state-of-the-art approaches like ELLA and significantly improving IncLoRA performance.
AINeutralarXiv – CS AI · Apr 156/10
🧠Researchers propose LIFE, an energy-efficient AI framework designed to address the computational demands of high-performance computing systems through continual learning and agentic AI rather than monolithic transformers. The system combines orchestration, context engineering, memory management, and lattice learning to enable self-evolving network operations, demonstrated through HPC latency spike detection and mitigation.
AINeutralarXiv – CS AI · Apr 156/10
🧠Researchers propose an SVD-based orthogonal subspace projection method for continual machine unlearning that prevents interference between sequential deletion tasks in neural networks. The approach maintains model performance on retained data while effectively removing influence of unlearned data, addressing a critical limitation of naive LoRA fusion methods.
AIBullisharXiv – CS AI · Apr 156/10
🧠Researchers propose Joint Flashback Adaptation, a novel method to address catastrophic forgetting in large language models during incremental task learning. The approach uses limited prompts from previous tasks combined with latent task interpolation, demonstrating improved performance across 1000+ instruction-following and reasoning tasks without requiring full replay data.
AIBullisharXiv – CS AI · Apr 146/10
🧠Researchers introduce Modular Delta Merging with Orthogonal Constraints (MDM-OC), a machine learning framework that enables multiple fine-tuned models to be merged, updated, and selectively removed without performance degradation or task interference. The approach uses orthogonal projections to prevent model conflicts and supports compliance requirements like GDPR-mandated data deletion.
AINeutralarXiv – CS AI · Apr 136/10
🧠Researchers propose FEAT, a federated learning method that improves continual learning by addressing class imbalance and representation collapse across distributed clients. The approach combines geometric alignment and energy-based correction to better utilize exemplar samples while maintaining performance under dynamic heterogeneity.
AIBullisharXiv – CS AI · Mar 176/10
🧠Researchers propose a 'universe routing' solution for AI agents that struggle to choose appropriate reasoning frameworks when faced with different types of questions. The study shows that hard routing to specialized solvers is 7x faster than soft mixing approaches, with a 465M-parameter router achieving superior generalization and zero forgetting in continual learning scenarios.
🏢 Meta
AIBullisharXiv – CS AI · Mar 176/10
🧠Researchers introduce CATFormer, a new spiking neural network architecture that solves catastrophic forgetting in continual learning through dynamic threshold neurons. The framework uses context-adaptive thresholds and task-agnostic inference to maintain knowledge across multiple learning tasks without performance degradation.
AINeutralarXiv – CS AI · Mar 166/10
🧠This comprehensive survey examines continual learning methodologies for large language models, focusing on three core training stages and methods to mitigate catastrophic forgetting. The research reveals that while current approaches show promise in specific domains, fundamental challenges remain in achieving seamless knowledge integration across diverse tasks and temporal scales.
AIBullisharXiv – CS AI · Mar 166/10
🧠Researchers developed UniPrompt-CL, a new continual learning method specifically designed for medical AI that addresses the limitations of existing approaches when applied to medical data. The method uses a unified prompt pool design and regularization to achieve better performance while reducing computational costs, improving accuracy by 1-3 percentage points in domain-incremental learning settings.
AIBullisharXiv – CS AI · Mar 166/10
🧠Researchers developed UNIFIER, a continual learning framework for multimodal large language models (MLLMs) to adapt to changing visual scenarios without catastrophic forgetting. The framework addresses visual discrepancies across different environments like high-altitude, underwater, low-altitude, and indoor scenarios, showing significant improvements over existing methods.
🏢 Hugging Face
AIBullisharXiv – CS AI · Mar 126/10
🧠Researchers developed a new continual learning framework for human activity recognition (HAR) in IoT wearable devices that prevents AI models from forgetting previous tasks when learning new ones. The method uses gated adaptation to achieve 77.7% accuracy while reducing forgetting from 39.7% to 16.2%, training only 2% of parameters.
AIBullisharXiv – CS AI · Mar 116/10
🧠Researchers propose MSSR (Memory-Inspired Sampler and Scheduler Replay), a new framework for continual fine-tuning of large language models that mitigates catastrophic forgetting while maintaining adaptability. The method estimates sample-level memory strength and schedules rehearsal at adaptive intervals, showing superior performance across three backbone models and 11 sequential tasks compared to existing replay-based strategies.
AIBullisharXiv – CS AI · Mar 36/108
🧠Researchers propose IDER (Idempotent Experience Replay), a new continual learning method that addresses catastrophic forgetting in neural networks while improving prediction reliability. The approach uses idempotent properties to help AI models retain previously learned knowledge when acquiring new tasks, with demonstrated improvements in accuracy and reduced computational overhead.
AIBullisharXiv – CS AI · Mar 37/107
🧠Researchers propose DeLo, a new framework using dual-decomposed low-rank expert architecture to help Large Multimodal Models adapt to real-world scenarios with incomplete data. The system addresses continual missing modality learning by preventing interference between different data types and tasks through specialized routing and memory mechanisms.
AIBullisharXiv – CS AI · Mar 36/1011
🧠Researchers developed FreeGNN, a continual source-free graph neural network framework for renewable energy forecasting that adapts to new sites without requiring source data or target labels. The system uses a teacher-student strategy with memory replay and achieved strong performance across three real-world datasets including GEFCom2012, Solar PV, and Wind SCADA.
AINeutralarXiv – CS AI · Mar 37/108
🧠Researchers propose Streaming Continual Learning (SCL) as a unified paradigm that combines Continual Learning and Streaming Machine Learning approaches. SCL aims to enable AI systems to both rapidly adapt to new information and retain previously learned knowledge, addressing limitations of existing methods that excel at only one aspect.
AIBullisharXiv – CS AI · Mar 37/104
🧠Researchers propose combining In-Weight Learning (IWL) and In-Context Learning (ICL) through modular memory architectures to solve continual learning challenges in AI. The framework aims to enable AI agents to continuously adapt and accumulate knowledge without catastrophic forgetting, addressing key limitations of current foundation models.
AIBullisharXiv – CS AI · Mar 36/103
🧠Researchers introduce Fly-CL, a bio-inspired framework for continual representation learning that significantly reduces training time while maintaining performance comparable to state-of-the-art methods. The approach, inspired by fly olfactory circuits, addresses multicollinearity issues in pre-trained models and enables more efficient similarity matching for real-time applications.
AINeutralarXiv – CS AI · Mar 35/103
🧠Researchers propose FIRE, a new reinitialization method for deep neural networks that balances stability and plasticity when learning from nonstationary data. The method uses mathematical optimization to maintain prior knowledge while adapting to new tasks, showing superior performance across visual learning, language modeling, and reinforcement learning domains.
