AINeutralarXiv – CS AI · 7h ago6/10
🧠
TPA: Next Token Probability Attribution for Detecting Hallucinations in RAG
Researchers propose TPA (Token Probability Attribution), a new method for detecting hallucinations in Retrieval-Augmented Generation systems by attributing token generation to seven distinct sources rather than the traditional binary approach. The technique uses Part-of-Speech tagging to identify anomalies in how different linguistic categories are generated, achieving state-of-the-art detection performance.