Supervised Fine-tuning with Synthetic Rationale Data Hurts Real-World Disease Prediction
A large-scale study challenges the widespread assumption that fine-tuning language models with synthetic explanations improves clinical prediction performance. Researchers found that rationale-based supervised fine-tuning consistently degraded Alzheimer's disease prediction accuracy compared to label-only approaches, despite the rationales being medically accurate and human-verified.