AINeutralarXiv – CS AI · 14h ago6/10
🧠
Influencing Humans to Conform to Preference Models for RLHF
Researchers demonstrate that human preferences can be influenced to better align with the mathematical models used in RLHF algorithms, without changing underlying reward functions. Through three interventions—revealing model parameters, training humans on preference models, and modifying elicitation questions—the study shows significant improvements in preference data quality and AI alignment outcomes.