AINeutralarXiv – CS AI · Jun 236/10
🧠
Modularized Reinforcement Learning on LLMs: From MDP Creation to Exploration and Learning
A comprehensive survey maps reinforcement learning algorithm design decisions across three stages—MDP creation, exploration strategies, and learning approaches—revealing significant research gaps in LLM training where value-based methods and off-policy techniques remain underexplored despite proven effectiveness in classical RL.