#translation-quality News & Analysis

4 articles tagged with #translation-quality. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles

AIBullisharXiv – CS AI · Jun 96/10

🧠

Rewrite to Translate, Translate to Reward: Reinforcement Learning for Source Rewriting in Machine Translation

Researchers introduce RLSR, a reinforcement learning framework that trains smaller language models to rewrite source text for improved machine translation without manual prompt tuning. The approach achieves competitive performance with larger models across six MT systems and 16 language pairs, demonstrating that RL-optimized 4B parameter models can match capabilities of 235B parameter prompt-based systems.

AINeutralarXiv – CS AI · Jun 16/10

🧠

OpenSTBench: Beyond Semantic Evaluation for Speech Translation

OpenSTBench introduces a unified evaluation framework for assessing speech translation systems across multiple dimensions including translation quality, speech quality, speaker preservation, and temporal consistency. The framework addresses a critical gap in the field by enabling comprehensive comparison of heterogeneous speech translation outputs that differ in modality and timing behavior, with code and datasets made publicly available.

AINeutralarXiv – CS AI · Mar 124/10

🧠

Automated evaluation of LLMs for effective machine translation of Mandarin Chinese to English

Researchers developed an automated framework to evaluate Large Language Models' effectiveness in translating Mandarin Chinese to English, comparing GPT-4, GPT-4o, and DeepSeek against Google Translate. While LLMs performed well on news translation, they showed varying results with literary texts, with DeepSeek excelling at cultural subtleties and GPT-4o/DeepSeek better at semantic conservation.

🏢 Meta🧠 GPT-4

AINeutralarXiv – CS AI · Mar 25/104

🧠

Terminology Rarity Predicts Catastrophic Failure in LLM Translation of Low-Resource Ancient Languages: Evidence from Ancient Greek

A study evaluated large language models (Claude, Gemini, ChatGPT) translating Ancient Greek texts, finding high performance on previously translated works (95.2/100) but declining quality on untranslated technical texts (79.9/100). Terminology rarity was identified as a strong predictor of translation failure, with rare terms causing catastrophic performance drops.