AIBullisharXiv – CS AI · Jun 87/10
🧠
Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders
Researchers demonstrate that Whisper, OpenAI's widely-used speech recognition model, can detect and mitigate hallucinations—fabricated coherent transcriptions from non-speech audio—using Sparse AutoEncoders and activation-space steering. The approach reduces hallucination rates from 72-87% to 14-27% across model sizes with minimal performance degradation on actual speech.