AINeutralarXiv – CS AI · 7h ago6/10
🧠
Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling
Researchers identify and address Perceptual Judgment Bias in multimodal large language models used as automated evaluators, where these models favor plausible narratives over visually accurate answers when text and images conflict. The team develops a training framework using perceptually perturbed datasets and reward modeling that improves MLLM judges' visual grounding and evaluation consistency across benchmarks.