y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#meta-evaluation News & Analysis

2 articles tagged with #meta-evaluation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AINeutralarXiv – CS AI · 3d ago6/10
🧠

Conversation for Non-verifiable Learning: Self-Evolving LLMs through Meta-Evaluation

Researchers introduce CoNL, a framework that enables large language models to improve themselves through multi-agent self-play without requiring ground-truth labels or external judges. The system uses critiques that successfully improve solutions as training signals, allowing models to jointly optimize both generation and evaluation capabilities for non-verifiable tasks like creative writing and ethical reasoning.

AINeutralarXiv – CS AI · Mar 276/10
🧠

RubricEval: A Rubric-Level Meta-Evaluation Benchmark for LLM Judges in Instruction Following

Researchers introduce RubricEval, the first rubric-level meta-evaluation benchmark for assessing how well AI judges evaluate instruction-following in large language models. Even advanced models like GPT-4o achieve only 55.97% accuracy on the challenging subset, highlighting significant gaps in AI evaluation reliability.

🧠 GPT-4