AINeutralarXiv – CS AI · 10h ago6/10
🧠
Evaluating Large Language Models for Hausa and Fongbe Machine Translation: Benchmarks, Failures, and Metric Reliability
Researchers evaluated four major LLMs (GPT-4o Mini, Claude Sonnet 4, Gemini 2.5 Flash, Qwen2.5-7B) on English-to-Hausa and English-to-Fongbe translation, finding that translation quality varies dramatically by language, model rankings differ across languages, and automatic evaluation metrics show weak correlation with human judgment for low-resource African languages.
🧠 GPT-4🧠 Claude🧠 Sonnet