#machine-learning-theory News & Analysis

28 articles tagged with #machine-learning-theory. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

28 articles

AINeutralarXiv – CS AI · May 126/10

🧠

FragileFlow: Spectral Control of Correct-but-Fragile Predictions for Foundation Model Robustness

FragileFlow introduces a theoretical framework and practical regularizer to detect and mitigate a hidden failure mode in large language models and vision-language models where predictions remain technically correct but confidence margins narrow dangerously. The research provides the first PAC-Bayes bounds for margin-aware error flow, addressing robustness gaps that standard accuracy metrics overlook.

AINeutralarXiv – CS AI · May 116/10

🧠

A Generalized Singular Value Theory for Neural Networks

Researchers prove that modern neural networks can be represented using a Generalized Singular Value Decomposition that makes them left-invertible before a final linear layer while preserving norm properties. This mathematical framework enables distance calibration between feature space and input space, with demonstrated applications to adversarial perturbation detection and potential future use in addressing model bias and invertibility.

AINeutralarXiv – CS AI · Apr 146/10

🧠

Tail-Aware Information-Theoretic Generalization for RLHF and SGLD

Researchers develop a new information-theoretic framework that handles heavy-tailed data distributions, addressing limitations in classical generalization bounds used in machine learning. The work applies specifically to reinforcement learning from human feedback (RLHF) and stochastic gradient optimization, where traditional KL-divergence tools fail due to non-existent moment generating functions.

← PrevPage 2 of 2