AINeutralarXiv – CS AI · 14h ago6/10
🧠
A Triadic Suffix Tokenization Scheme for Numerical Reasoning
Researchers propose Triadic Suffix Tokenization (TST), a novel tokenization scheme that addresses how large language models process numbers by fragmenting digits into three-digit groups with explicit magnitude markers. The method aims to improve arithmetic and scientific reasoning in LLMs by preserving decimal structure and positional information, with two implementation variants offering scalability across 33 orders of magnitude.