#adaptive-testing News & Analysis

4 articles tagged with #adaptive-testing. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles

AINeutralarXiv – CS AI · May 97/10

🧠

Beyond Fixed Benchmarks and Worst-Case Attacks: Dynamic Boundary Evaluation for Language Models

Researchers propose Dynamic Boundary Evaluation (DBE), a new methodology for assessing large language models that adapts to each model's capability level rather than applying fixed benchmarks. The approach identifies performance boundaries where models achieve ~50% accuracy and calibrates them on a unified difficulty scale, addressing limitations in traditional evaluation that produce ceiling and floor effects masking true capability gaps.

AINeutralarXiv – CS AI · Jun 236/10

🧠

AgentCAT: Simulating Computerized Adaptive Testing via Multi-Agent Large Language Models

AgentCAT is a new Large Language Model-based multi-agent simulation system designed to improve computerized adaptive testing (CAT) by creating a high-fidelity benchmarking environment. The framework addresses limitations of existing CAT research by simulating the complete dynamic assessment process through three specialized agents: an examinee agent with reasoning capabilities, a selection agent for exercise optimization, and a supervisor ensuring validity.

AINeutralarXiv – CS AI · May 295/10

🧠

Agent4Edu: Generating Learner Response Data by Generative Agents for Intelligent Education Systems

Agent4Edu introduces an AI-powered simulator using large language models to generate synthetic learner response data for educational systems. The system creates LLM-based agents with learner profiles, memory, and action modules to evaluate personalized learning algorithms and bridge gaps between offline metrics and real-world performance.

AINeutralarXiv – CS AI · Mar 266/10

🧠

DepthCharge: A Domain-Agnostic Framework for Measuring Depth-Dependent Knowledge in Large Language Models

Researchers developed DepthCharge, a new framework for measuring how deeply large language models can maintain accurate responses when questioned about domain-specific knowledge. Testing across four domains revealed significant variation in model performance depth, with no single AI model dominating all areas and expensive models not always achieving superior results.