AINeutralarXiv – CS AI · 3h ago6/10
🧠
Probability-Entropy Calibration: An Elastic Indicator for Adaptive Fine-tuning
RankTuner, a new fine-tuning mechanism, introduces probability-entropy calibration to improve supervised learning in large language models. By combining ground-truth probability with token entropy metrics through a Relative Rank Indicator, the approach achieves better performance on mathematical reasoning and code generation tasks compared to single-metric baselines.