AIBullisharXiv – CS AI · Jun 237/10
🧠
Oracle-RLAIF: An Improved Fine-Tuning Framework for Multi-modal Video Models using Reinforcement Learning from Ranking Feedback
Researchers propose Oracle-RLAIF, a novel fine-tuning framework for video-language models that replaces expensive trained reward models with a general-purpose oracle ranker, paired with a new rank-based loss function (GRPO_rank). This approach significantly reduces the cost of gathering human feedback while improving performance across video comprehension benchmarks.