y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#rubric-based-assessment News & Analysis

2 articles tagged with #rubric-based-assessment. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AIBullisharXiv – CS AI · Jun 97/10
🧠

ComplexConstraints and Beyond: Expert Rubrics for RLVR

Researchers present a systematic framework for evaluating large language models using expert-curated rubrics instead of traditional programmatic benchmarks. The ComplexConstraints dataset demonstrates that rubric-based evaluation and training improves instruction-following performance by 12-15% across model sizes and transfers gains to out-of-distribution benchmarks.

AINeutralarXiv – CS AI · May 46/10
🧠

Evaluating Legal Reasoning Traces with Legal Issue Tree Rubrics

Researchers introduce LEGIT, a 24K-instance legal reasoning dataset with hierarchical argument trees that serve as evaluation rubrics for LLM-generated legal reasoning. The study reveals that LLM legal reasoning performance depends critically on both issue coverage and correctness, with RAG and reinforcement learning offering complementary improvements.