3 articles tagged with #sharpness-aware-minimization. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.
Researchers demonstrate that Sharpness-Aware Minimization (SAM), a recently proposed neural network training method, significantly improves model calibration by reducing overconfidence in predictions. The study includes a new variant called CSAM that further enhances calibration performance across multiple datasets, with important implications for safety-critical AI applications.
Researchers reveal that Sharpness-Aware Minimization (SAM), a popular deep learning training method, has convergence instability near saddle points and may actually escape saddle points more poorly than standard gradient descent. The study demonstrates that momentum and batch-size adjustments are critical for mitigating these instabilities and achieving strong generalization performance.
Researchers propose NCSAM, a novel optimization-based approach to learning from noisy labels that theoretically connects label noise to Sharpness-Aware Minimization's behavior. The method uses noise-compensated perturbations to reduce memorization of corrupted annotations while maintaining optimization simplicity, demonstrating competitive performance against existing noisy-label learning methods.
