#automated-scoring News & Analysis

3 articles tagged with #automated-scoring. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AINeutralarXiv – CS AI · Mar 26/1019

🧠

BRIDGE the Gap: Mitigating Bias Amplification in Automated Scoring of English Language Learners via Inter-group Data Augmentation

Researchers developed BRIDGE, a framework to reduce bias in AI-powered automated scoring systems that unfairly penalize English Language Learners (ELLs). The system addresses representation bias by generating synthetic high-scoring ELL samples, achieving fairness improvements comparable to using additional human data while maintaining overall performance.

AIBullisharXiv – CS AI · Mar 274/10

🧠

Measuring What Matters -- or What's Convenient?: Robustness of LLM-Based Scoring Systems to Construct-Irrelevant Factors

Researchers tested a dual-architecture LLM-based automated scoring system for educational assessments and found it generally robust to construct-irrelevant factors like meaningless text padding and spelling errors. The study shows promise for LLM-based scoring systems' reliability when properly designed, though off-topic responses were heavily penalized.

AINeutralarXiv – CS AI · Mar 95/10

🧠

Automated Coding of Communication Data Using ChatGPT: Consistency Across Subgroups

Research demonstrates that ChatGPT can code communication data with accuracy comparable to human raters while maintaining consistency across different demographic groups including gender and racial/ethnic categories. The study introduces three evaluation checks for assessing subgroup consistency in LLM-based coding systems for large-scale collaboration assessments.

🧠 ChatGPT