Bittensor’s Subnet 3 Trains 72B AI Model on Decentralized Network

Bittensor's Subnet 3 successfully trained Covenant-72B, a 72 billion parameter AI model on a decentralized network, outperforming LLaMA-2-70B with a 67.1 MMLU score versus 65.6. The achievement utilized SparseLoCo technology to reduce communication overhead by 146x and featured blockchain-based contribution tracking, driving TAO token up 14% to $236.