y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#mmlu News & Analysis

2 articles tagged with #mmlu. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AI × CryptoBullishBlockonomi · Mar 147/10
🤖

Bittensor’s Subnet 3 Trains 72B AI Model on Decentralized Network

Bittensor's Subnet 3 successfully trained Covenant-72B, a 72 billion parameter AI model on a decentralized network, outperforming LLaMA-2-70B with a 67.1 MMLU score versus 65.6. The achievement utilized SparseLoCo technology to reduce communication overhead by 146x and featured blockchain-based contribution tracking, driving TAO token up 14% to $236.

$TAO
AINeutralarXiv – CS AI · Mar 276/10
🧠

Efficient Detection of Bad Benchmark Items with Novel Scalability Coefficients

Researchers introduce a new nonparametric method called signed isotonic R² for efficiently detecting problematic items in AI benchmarks and assessments. The method outperforms traditional diagnostic techniques across major AI datasets including GSM8K and MMLU, offering a lightweight solution for improving evaluation quality.