y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#educational-assessment News & Analysis

4 articles tagged with #educational-assessment. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles
AINeutralarXiv – CS AI · Jun 195/10
🧠

Measuring Curriculum Alignment across Topical Coverage, Competency, and Cognitive Depth: A Longitudinal Framework Applied to CS2013 and CS2023

Researchers developed a human-in-the-loop pipeline to measure how well computer science undergraduate programs align with international curricular guidelines, applying it longitudinally to CS2013 and CS2023 standards. The analysis reveals persistent structural gaps in parallel computing, programming languages, and systems fundamentals across both decades, while showing program coverage remained near-constant at ~50% despite guideline restructuring.

AINeutralarXiv – CS AI · Jun 56/10
🧠

From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment

Researchers propose a framework combining SHAP explainability with LLM-generated rationales to improve transparency in automated rubric-based scoring systems for educational assessment. Testing on classroom transcripts reveals fine-tuned language models outperform LLMs in accuracy, but SHAP attributions provide more faithful and transferable explanations than LLM rationales across different model architectures.

AIBullisharXiv – CS AI · Mar 274/10
🧠

Measuring What Matters -- or What's Convenient?: Robustness of LLM-Based Scoring Systems to Construct-Irrelevant Factors

Researchers tested a dual-architecture LLM-based automated scoring system for educational assessments and found it generally robust to construct-irrelevant factors like meaningless text padding and spelling errors. The study shows promise for LLM-based scoring systems' reliability when properly designed, though off-topic responses were heavily penalized.