#clinical-evaluation News & Analysis

2 articles tagged with #clinical-evaluation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AIBearisharXiv – CS AI · Jun 197/10

🧠

Creating Multilingual Mental Health Dialogue Datasets: Limits of Persona-Based Localization via Nationality and Language

Researchers reveal significant limitations in using English-centric persona-based methods to generate multilingual mental health datasets, finding that simply adding nationality and language parameters introduces clinical inconsistencies and causes LLM evaluators to perform poorly on non-English depression severity assessments. The study underscores the urgent need for culturally responsive data generation approaches to build equitable AI mental health systems globally.

AIBearisharXiv – CS AI · Jun 236/10

🧠

CheXpercept: A Benchmark for Evaluating Expert-Level Lesion Perception in Chest X-rays

Researchers introduce CheXpercept, a benchmark dataset for evaluating vision-language models on chest X-ray analysis that goes beyond simple disease classification to test clinical-grade lesion perception. Testing 14 VLMs reveals that models perform adequately only at basic detection levels, with accuracy declining sharply on more complex visual tasks, and medical-specific models show no meaningful advantage over general models.