y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#token-probability News & Analysis

2 articles tagged with #token-probability. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles
AINeutralarXiv – CS AI · May 287/10
🧠

Asking Is Not Enough: Protocol Sensitivity in LLM Confidence Calibration

Researchers demonstrate that Large Language Model (LLM) confidence calibration measurements are highly sensitive to methodological choices, including how answers are selected, token probabilities are calculated, and conditioning contexts are applied. The study reveals that verbalized confidence often reflects answer plausibility rather than actual correctness, challenging assumptions about LLM uncertainty quantification.

AINeutralarXiv – CS AI · May 116/10
🧠

Detecting Distillation Data from Reasoning Models

Researchers have developed Token Probability Deviation (TPD), a method to detect whether questions were included in a reasoning model's distillation training data. The technique addresses data contamination risks in reasoning distillation, where benchmark data may inadvertently inflate model performance metrics, achieving up to 31% improvement in detection accuracy.