y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#loss-functions News & Analysis

8 articles tagged with #loss-functions. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

8 articles
AINeutralarXiv – CS AI · Jun 236/10
🧠

New Smooth Loss functions for Robust Regression that Closely Approximate Absolute Error and Provide Improved Performance on Datasets With Significant Outliers

Researchers introduce two new differentiable loss functions—Square Root Loss (SRL) and Smooth Mean Absolute Error (SMAE)—that better approximate Mean Absolute Error while improving robustness in regression tasks with outlier-heavy datasets. These functions address limitations of existing approaches like MSE and MAE by providing superior mathematical properties and training stability.

AINeutralarXiv – CS AI · Jun 95/10
🧠

3D Oral Modelling with Improved Vertex Distribution Using Matching-Based Learning

Researchers improved a deep learning framework for 3D oral reconstruction by introducing Hungarian matching and Repulsion Loss to achieve more uniform vertex distribution across predicted dental models. While numerical accuracy decreased from 77.49% to 68.02%, the trade-off eliminates vertex clustering in sparse regions, producing more clinically useful reconstructions from intraoral images.

AINeutralarXiv – CS AI · Jun 46/10
🧠

Bayes-Sufficient Representations in Supervised Learning

A new theoretical framework defines Bayes-sufficient representations in supervised learning, establishing what information is genuinely required for optimal predictions based on loss functions. The work formalizes the concept of Bayes quotients and minimal representations, connecting representation learning to property elicitation theory with experimental validation across synthetic and real datasets.

AINeutralarXiv – CS AI · Jun 26/10
🧠

MoEIoU: Rethinking Bounding-Box Regression as a Mixture of Experts

Researchers introduce MoEIoU, a novel machine learning approach that reformulates bounding-box regression for object detection using a mixture-of-experts framework. The method dynamically balances multiple localization objectives during training, outperforming existing solutions across standard benchmarks and architectures.

AINeutralarXiv – CS AI · Jun 16/10
🧠

Score Broadcast and Decorrelation: A General Framework for Broadcast-Based Credit Assignment

Researchers introduce Score Broadcast and Decorrelation (SBD), a theoretical framework that generalizes biologically plausible credit assignment mechanisms across diverse loss functions beyond MSE. The framework unifies error broadcast—an alternative to backpropagation that avoids weight transport—under a single orthogonality principle, with experimental validation showing improvements over existing broadcast approaches on image classification tasks.

AINeutralarXiv – CS AI · May 296/10
🧠

Beyond MSE: Improving Precipitation Nowcasting with Multi-Quantile Regression

Researchers demonstrate that multi-quantile regression training improves deep learning precipitation forecasting models compared to traditional mean squared error optimization. The approach reduces forecast smoothing, better captures extreme rainfall events, and achieves 8.6% lower test error while providing probabilistic outputs without requiring new architectures.

AINeutralarXiv – CS AI · May 116/10
🧠

Generalized Euler Logarithm and its Applications in Machine Learning: Natural Gradient, Backpropagation, Generalized EG, Mirror Descent and OLPS

Researchers present a comprehensive mathematical framework unifying generalized Euler logarithms with applications to machine learning optimization. The work establishes theoretical foundations for deformed exponential functions and introduces new algorithms—Generalized Exponentiated Gradient and Mirror Descent schemes—alongside an Euler-based loss function for neural networks that integrates with natural gradient descent.

AINeutralarXiv – CS AI · Apr 136/10
🧠

Silhouette Loss: Differentiable Global Structure Learning for Deep Representations

Researchers introduce Soft Silhouette Loss, a novel machine learning objective that improves deep neural network representations by enforcing intra-class compactness and inter-class separation. The lightweight differentiable loss outperforms cross-entropy and supervised contrastive learning when combined, achieving 39.08% top-1 accuracy compared to 37.85% for existing methods while reducing computational overhead.