#decentralized-learning News & Analysis

6 articles tagged with #decentralized-learning. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

6 articles

AI × CryptoBullisharXiv – CS AI · Jun 27/10

🤖

GRANITE : a Byzantine-Resilient Dynamic Gossip Learning Framework

GRANITE is a new Byzantine-resilient framework for decentralized gossip learning that addresses vulnerabilities in dynamic peer sampling protocols used in distributed machine learning. The system demonstrates resilience against coordinated attacks where malicious nodes both poison models and manipulate network topology, achieving near-optimal accuracy with up to 30% Byzantine nodes while reducing communication costs by 9x.

AIBullisharXiv – CS AI · May 117/10

🧠

\mathsf{VISTA}: Decentralized Machine Learning in Adversary Dominated Environments

VISTA is a novel decentralized machine learning algorithm designed to operate securely when adversaries control the majority of worker nodes. By implementing an incentive-based framework that rewards mutually consistent reports, the system converts adversarial nodes from pure saboteurs into rational agents, enabling convergence comparable to standard SGD without requiring an honest majority.

AIBullisharXiv – CS AI · Jun 106/10

🧠

Unifying Local Communications and Local Updates for LLM Pretraining

Researchers introduce GASLoC, a decentralized pre-training algorithm that reduces communication overhead in distributed LLM training by enabling local optimizer steps and sparse peer communication instead of synchronous operations. The method demonstrates competitive or superior performance compared to existing approaches, particularly in heterogeneous bandwidth environments where worker speeds vary significantly.

AINeutralarXiv – CS AI · May 286/10

🧠

FedMPT: Federated Multi-label Prompt Tuning of Vision-Language Models

Researchers introduce FedMPT, a novel federated learning method for multi-label recognition in vision-language models that addresses overfitting to spurious label correlations in decentralized settings. The approach uses causal modeling, LLM-driven condition analysis, and optimal transport mechanisms to improve model robustness when adapting to clients with heterogeneous private data.

AINeutralarXiv – CS AI · May 286/10

🧠

HEAL: Resilient and Self-* Hub-based Learning

Researchers introduce HEAL, a decentralized machine learning framework that combines federated learning's efficiency with gossip learning's fault tolerance through a self-healing peer-to-peer overlay network. The system dynamically promotes nodes as aggregators, achieving federated learning performance while remaining fully decentralized and resilient to node failures.

AINeutralarXiv – CS AI · May 116/10

🧠

Decentralized Time-Varying Optimization for Streaming Data via Temporal Weighting

Researchers propose a decentralized gradient descent framework for optimizing time-varying objectives across distributed networks processing streaming data. The work analyzes tracking error using temporal weighting strategies, showing uniform weighting achieves O(1/t) convergence while exponential discounting maintains non-vanishing error floors, with implications for distributed machine learning systems.