y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#energy-based-models News & Analysis

12 articles tagged with #energy-based-models. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

12 articles
AIBullisharXiv – CS AI · Mar 46/102
🧠

CoBELa: Steering Transparent Generation via Concept Bottlenecks on Energy Landscapes

Researchers introduce CoBELa, a new AI framework for interpretable image generation that uses concept bottlenecks on energy landscapes to enable transparent, controllable synthesis without requiring decoder retraining. The system achieves strong performance on benchmark datasets while allowing users to compositionally manipulate concepts through energy function combinations.

AIBullisharXiv – CS AI · Mar 47/103
🧠

Mitigating Over-Refusal in Aligned Large Language Models via Inference-Time Activation Energy

Researchers introduce Energy Landscape Steering (ELS), a new framework that reduces false refusals in AI safety-aligned language models without compromising security. The method uses an external Energy-Based Model to dynamically guide model behavior during inference, improving compliance from 57.3% to 82.6% on safety benchmarks.

AIBullishOpenAI News · Nov 77/107
🧠

Learning concepts with energy functions

Researchers developed an energy-based AI model that can learn spatial concepts like 'near' and 'above' from just five demonstrations using 2D point sets. The model demonstrates cross-domain transfer capabilities, applying concepts learned in 2D particle environments to solve 3D physics-based robotics tasks.

$NEAR
AINeutralarXiv – CS AI · Jun 236/10
🧠

Energy-Based Transformers as Predictors of Reading Difficulty

Researchers demonstrate that energy-based transformers, a class of neural networks linked to associative memory models, effectively predict reading difficulty across multiple eye-tracking and reading-time studies. The energy measure outperforms traditional metrics like surprisal and attention entropy, suggesting a unified approach to modeling human language processing.

AINeutralarXiv – CS AI · Jun 106/10
🧠

ERAlign: Energy-based Representation Alignment of GNNs and LLMs on Text-attributed Graphs

Researchers propose ERAlign, an energy-based framework that aligns representations from Graph Neural Networks and Large Language Models when processing text-attributed graphs. The approach uses energy-based models to achieve distribution consistency between graph structure and text embeddings, demonstrating state-of-the-art performance across multiple datasets.

AINeutralarXiv – CS AI · Jun 56/10
🧠

Learning What Matters: Probabilistic Task Selection via Mutual Information for Model Finetuning

Researchers introduce TaskPGM, a framework that optimizes how training data is distributed across multiple tasks when fine-tuning large language models by modeling task relationships through an energy-based probabilistic approach. The method balances task coverage against redundancy, demonstrating improvements over conventional uniform or size-proportional sampling strategies across multiple model families and evaluation benchmarks.

AINeutralarXiv – CS AI · Jun 26/10
🧠

naPINN: Noise-Adaptive Physics-Informed Neural Networks for Recovering Physics from Corrupted Measurement

Researchers introduce naPINN (Noise-Adaptive Physics-Informed Neural Networks), a novel machine learning approach that recovers accurate physical equations from corrupted or noisy measurement data without requiring prior knowledge of noise characteristics. The method uses energy-based models to identify and filter outliers while maintaining data integrity, substantially outperforming existing robust PINN methods across benchmark tests with non-Gaussian noise and varying outlier rates.

AIBullisharXiv – CS AI · May 126/10
🧠

Constant-Target Energy Matching: A Unified Framework for Continuous and Discrete Density Estimation

Researchers introduce Constant-Target Energy Matching (CTEM), a unified framework for density estimation that handles continuous, discrete, and mixed-variable data types within a single objective function. CTEM replaces traditional density-ratio regression with a bounded energy-difference transform, eliminating instability issues and partition-function estimation requirements while delivering improved sample quality across diverse data domains.

AINeutralarXiv – CS AI · May 116/10
🧠

Revisiting Transformer Layer Parameterization Through Causal Energy Minimization

Researchers introduce Causal Energy Minimization (CEM), a theoretical framework that reinterprets Transformer layer architecture through energy-based optimization principles. The approach derives weight-tied attention and gated MLPs as gradient updates on energy functions, revealing new design spaces for parameter-efficient Transformer variants that maintain baseline performance at hundred-million-parameter scales.

AIBullisharXiv – CS AI · Mar 36/102
🧠

Spilled Energy in Large Language Models

Researchers developed a training-free method to detect AI hallucinations by reinterpreting LLM output as Energy-Based Models and tracking 'energy spills' during text generation. The approach successfully identifies factual errors and biases across multiple state-of-the-art models including LLaMA, Mistral, and Gemma without requiring additional training or probe classifiers.

AIBullishOpenAI News · Mar 216/104
🧠

Implicit generation and generalization methods for energy-based models

Researchers have achieved progress in training energy-based models (EBMs) with improved stability and scalability, resulting in better sample quality and generalization. The models can generate samples competitive with GANs while maintaining mode coverage guarantees of likelihood-based models through iterative refinement.