7 articles tagged with #hopfield-networks. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers have developed Geometry Aware Attention Guidance (GAG), a new method that improves diffusion model generation quality by optimizing attention-space extrapolation. The approach models attention dynamics as fixed-point iterations within Modern Hopfield Networks and applies Anderson Acceleration to stabilize the process while reducing computational costs.
Researchers propose Convolutional Restricted Hopfield Networks (CRHNs), a new associative memory model that combines convolutional feature extraction with attractor-based retrieval to improve robustness against adversarial attacks and data corruption. Experiments demonstrate CRHNs achieve significantly lower reconstruction errors than existing models like Modern Hopfield Networks and Predictive Coding Networks, with improvements up to an order of magnitude under various perturbation conditions.
Researchers introduce FlowEdit, a lifelong adaptation framework for text-to-speech systems that corrects pronunciation errors without retraining the underlying model. Using associative memory and latent conditioning edits, FlowEdit achieves 92.7% error reduction on multilingual proper nouns while maintaining speech quality and completing corrections in ~15 seconds.
Researchers propose a theoretical framework demonstrating that hippocampal neural populations organize in hyperbolic geometry, enabling larger memory capacity and improved decoding accuracy. By connecting neural decoding to associative memory through Modern Hopfield Networks and introducing a hyperbolic-space memory model, the study suggests animals encode spatial information as latent hyperbolic cognitive maps.
Researchers decompose transformer attention matrices into symmetric and skew-symmetric components, using Hopfield network theory to analyze how attention structures affect the fidelity-diversity trade-off in diffusion models. The work provides a mathematical framework for understanding and controlling generation quality versus diversity through attention dynamics manipulation.
Researchers present HoReN, a novel method for editing large language models that preserves original knowledge while incorporating new information through a codebook-based external memory system. The approach uses Hopfield networks and angular similarity retrieval to handle up to 50,000 sequential edits, significantly outperforming existing model editing techniques that degrade at scale.
Researchers introduce Graph Hopfield Networks, a new neural network architecture that combines associative memory with graph-based learning for node classification tasks. The method shows improvements of up to 5 percentage points on robustness tests and 2 percentage points on citation networks, outperforming standard baselines across multiple graph types.
