y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#gradient-boosting News & Analysis

2 articles tagged with #gradient-boosting. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AIBullisharXiv – CS AI · Apr 66/10
🧠

Gradient Boosting within a Single Attention Layer

Researchers introduce gradient-boosted attention, a new method that improves transformer performance by applying gradient boosting principles within a single attention layer. The technique uses a second attention pass to correct errors from the first pass, achieving lower perplexity (67.9 vs 72.2) on WikiText-103 compared to standard attention mechanisms.

🏢 Perplexity
AINeutralarXiv – CS AI · Feb 274/106
🧠

Model Agreement via Anchoring

Researchers developed a new mathematical technique called 'anchoring' to control model disagreement between machine learning models trained independently. The method provides bounds for reducing disagreement to zero across four common ML algorithms including stacked aggregation, gradient boosting, neural networks, and regression trees.