AIBearisharXiv – CS AI · 10h ago7/10
🧠
Beyond 'One Language, One Script': Quantifying Orthographic Bias in Multilingual VLMs with PuMVR
Researchers introduce PuMVR, a benchmark revealing significant script-dependent bias in multilingual Vision-Language Models, where the same visual reasoning tasks produce accuracy gaps up to 16% depending on writing system used. The study exposes that current VLMs fail to handle multi-script languages like Punjabi equally, undermining claims of true multilingual capability and highlighting inequities in AI development.