AIBullisharXiv – CS AI · Apr 207/10
🧠Researchers introduce EVIL, an LLM-guided evolutionary approach that discovers interpretable Python algorithms for zero-shot inference on time series and event sequences without traditional neural network training. The evolved algorithms match or exceed deep learning performance while remaining transparent and significantly faster, demonstrating a novel paradigm for dynamical systems inference.
AIBullisharXiv – CS AI · Mar 167/10
🧠Researchers propose a new family of learnable Koopman operators that combine linear dynamical systems theory with deep learning for time series forecasting. The approach integrates with existing transformer architectures like Patchtst and Autoformer, offering improved stability and interpretability in predictive models.
AINeutralarXiv – CS AI · Mar 37/104
🧠Researchers have identified the mathematical mechanisms behind 'loss of plasticity' (LoP), explaining why deep learning models struggle to continue learning in changing environments. The study reveals that properties promoting generalization in static settings actually hinder continual learning by creating parameter space traps.
AINeutralarXiv – CS AI · Jun 106/10
🧠Researchers demonstrate that small LSTM neural networks exhibit critical dynamics near optimal training, displaying scale-free avalanche statistics and branching parameters close to unity, while larger models remain subcritical. The study introduces a mixture branching process framework to explain how subcritical dynamics can coexist with long-range temporal correlations, suggesting criticality emerges as a capacity-dependent property in artificial neural networks.
$AVAX
AINeutralarXiv – CS AI · Jun 96/10
🧠Researchers introduce LFNO (Laplace-Fourier Neural Operator), a unified neural network framework that combines spectral advantages of Laplace and Fourier transforms to model dynamical systems across transient and steady-state phases. The approach significantly outperforms existing methods on ODE benchmarks while remaining competitive on PDE systems, offering improved stability and interpretability for complex systems.
AINeutralarXiv – CS AI · Jun 96/10
🧠Researchers propose a geometric framework for machine intelligence where cognitive computation emerges from Riemannian gradient flow on learned latent manifolds, eliminating the need for explicit memory modules. The approach demonstrates superior robustness across reinforcement learning tasks involving partial observability, sensory disruptions, and long-horizon prediction compared to feedforward baselines.
AINeutralarXiv – CS AI · Jun 86/10
🧠A research position paper argues that time series modeling needs to adopt dynamical systems (DS) theory to move beyond current foundation model approaches. By reconstructing underlying system equations from data, DS-informed models could deliver superior long-term forecasting, lower computational costs, and theoretical guarantees about performance limits and generalization.
AINeutralarXiv – CS AI · Jun 26/10
🧠Researchers reveal that Sharpness-Aware Minimization (SAM), a popular deep learning training method, has convergence instability near saddle points and may actually escape saddle points more poorly than standard gradient descent. The study demonstrates that momentum and batch-size adjustments are critical for mitigating these instabilities and achieving strong generalization performance.
AINeutralarXiv – CS AI · May 296/10
🧠PrismFlow introduces a novel Flow Matching method for time-series generation that uses Koopman-inspired dynamical experts to address spectral distortion problems in existing models. By employing residual corrections and confidence-aware expert selection, the approach achieves significant performance improvements (15.6% gain in Context-FID, 38.6% in Discriminative Score) while maintaining stability and effectiveness in low-data scenarios.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers propose a mathematical model explaining how Mixture-of-Experts (MoE) neural networks can suddenly shift from balanced to imbalanced expert utilization. The model reveals a bifurcation mechanism where increased feedback strength triggers abrupt transitions between stable states, providing theoretical insight into a practical problem affecting large language models and distributed AI systems.
AINeutralarXiv – CS AI · May 296/10
🧠Researchers propose that distributional reinforcement learning offers superior performance in chaotic dynamical systems by measuring return distributions under the 1-Wasserstein metric rather than optimizing scalar expected values. This approach reduces variance and improves gradient conditioning in systems with exponential sensitivity to initial conditions, providing theoretical foundations for applying RL to climate, fluid dynamics, and multi-agent scenarios.
AINeutralarXiv – CS AI · May 276/10
🧠Researchers propose Lie Group Embedded Dynamical Neural Networks (LieEDNN), a novel neural architecture that leverages Lie group mathematics to model continuous symmetries in dynamic systems. The approach enables stable, learnable dynamics on smooth manifolds for applications in robotics, graphics, and control systems, with experimental validation on SE(3) group structures for telescopic manipulator control.
AINeutralarXiv – CS AI · May 126/10
🧠ASIA is an autonomous AI agent framework that automates system identification tasks by delegating model selection, training algorithms, and hyperparameter tuning to a large language model. The framework eliminates manual trial-and-error processes in dynamical systems modeling, though empirical testing reveals concerns around test leakage and reproducibility.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers present bifurcation models, a machine learning approach that uses weight-tied dynamical systems to learn multiple valid solutions for problems with set-valued outputs. Rather than forcing a single target label, the model represents an attractor landscape where different initializations converge to different stable equilibria, enabling discovery of diverse valid solutions without explicit branch labels.
AINeutralarXiv – CS AI · May 116/10
🧠Researchers introduce a spectral filtering method for learning complex-valued linear dynamical systems with sector-bounded spectrum, achieving dimension-free regret bounds for sequence prediction. The approach uses Slepian basis functions and demonstrates that learning efficiency depends on an effective dimension independent of state space size, with applications to signal processing and quantum systems.
AINeutralarXiv – CS AI · May 76/10
🧠Researchers demonstrate that recurrent neural networks implement computation through multi-hop pathways across graph structures rather than direct connections alone. They introduce resolvent-RNNs (R-RNNs) that constrain these pathways to achieve better temporal sparsity and robustness than traditional L1 regularization, revealing fundamental principles about how neural networks process information.
AINeutralarXiv – CS AI · May 46/10
🧠Researchers develop Koopman-assisted reinforcement learning algorithms that transform nonlinear control problems into linear coordinate spaces, making Hamilton-Jacobi-Bellman methods computationally tractable for complex systems. The approach demonstrates state-of-the-art performance compared to neural network-based baselines across diverse test cases from fluid dynamics to chaotic systems.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers have developed a novel algorithm for detecting invariant manifolds in ReLU-based recurrent neural networks (RNNs), enabling analysis of dynamical system behavior through topological and geometrical properties. The method identifies basin boundaries, multistability, and chaotic dynamics, with applications to scientific computing and explainable AI.
