#cross-lingual-performance News & Analysis

2 articles tagged with #cross-lingual-performance. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

2 articles

AINeutralarXiv – CS AI · Jun 96/10

🧠

Sci-Rho: A Multilingual Visually-Grounded Symbolic Benchmark for STEM Problems

Researchers introduce Sci-Rho, a multilingual benchmark comprising 42,420 visually-grounded STEM problem instances across seven languages designed to test the robustness of vision-language models. The study reveals significant gaps between average and worst-case accuracy, with smaller models showing greater performance degradation across languages while larger proprietary models demonstrate better robustness.

AINeutralarXiv – CS AI · May 286/10

🧠

DEPART: DEcomposing PARiTy across Multilingual LLMs

Researchers introduce DEPART, a Bayesian framework that systematically decomposes performance disparities across multilingual large language models into interpretable components. The study reveals that language features and representational similarity to English explain 79-92% of variance, with model identity dominating NLU tasks while benchmark-model interactions drive reasoning task differences.