AINeutralarXiv – CS AI · 14h ago6/10
🧠
Behavior-Aware Auxiliary Corrections for Off-Policy Temporal-Difference Prediction
Researchers propose behavior-aware auxiliary corrections for off-policy temporal-difference learning, introducing BA-TDC and BA-TDRC algorithms that replace standard covariance matrices with behavior Bellman matrices to improve stability in value-function approximation. The work provides theoretical convergence guarantees and demonstrates that behavior-aware geometry significantly benefits performance on certain tasks, though regularization remains necessary for robustness across diverse settings.