AIBearisharXiv – CS AI · May 277/10
🧠A research paper reveals that large language models used to create and evaluate benchmarks systematically favor themselves, introducing significant bias into automated evaluation systems. The self-bias stems from both test generation and evaluation stages, with stylistic tendencies creating model-specific outputs that inflate scores, even when diversity controls are explicitly applied.
AINeutralarXiv – CS AI · Apr 67/10
🧠Researchers studied weight-space model merging for multilingual machine translation and found it significantly degrades performance when target languages differ. Analysis reveals that fine-tuning redistributes rather than sharpens language selectivity in neural networks, increasing representational divergence in higher layers that govern text generation.
AIBullisharXiv – CS AI · Jun 256/10
🧠Researchers have developed a neural machine translation system for Tangkhul, a severely under-resourced Tibeto-Burman language spoken in Manipur, India, achieving a BLEU score of 39.97 using a fine-tuned ByT5-large model trained on 38,336 parallel sentences. This work addresses a significant gap in NLP infrastructure for one of India's marginalized linguistic communities and demonstrates practical approaches to machine translation for languages with minimal computational resources.
AINeutralarXiv – CS AI · Jun 256/10
🧠Researchers introduced STEB, a new benchmark for evaluating speech-to-speech translation systems on both translation accuracy and emotional expressiveness preservation. Testing six systems revealed that while translation fidelity is strong, emotion and nonverbal vocalization preservation remain significant challenges, highlighting a critical gap in current AI capabilities.
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers have developed a deep learning pipeline that recognizes sign language gestures from videos and translates them into Indian languages using VideoMAE and Meta's NLLB-200 model. The system achieves 78% validation accuracy on a 13-class dataset and demonstrates practical accessibility applications, though it currently handles isolated words rather than continuous signing.
🏢 Meta
AINeutralarXiv – CS AI · Jun 236/10
🧠Researchers evaluated four major LLMs (GPT-4o Mini, Claude Sonnet 4, Gemini 2.5 Flash, Qwen2.5-7B) on English-to-Hausa and English-to-Fongbe translation, finding that translation quality varies dramatically by language, model rankings differ across languages, and automatic evaluation metrics show weak correlation with human judgment for low-resource African languages.
🧠 GPT-4🧠 Claude🧠 Sonnet
AINeutralarXiv – CS AI · Jun 106/10
🧠Researchers at arXiv analyzed how large language models introduce distinctive emotional signatures when translating literary works, finding that LLM translations preserve author's voice less effectively than human translations. Post-editing partially corrects these emotional distortions, but MT systems consistently exhibit model-specific emotional fingerprints that deviate from human translation norms.
AIBullisharXiv – CS AI · Jun 96/10
🧠Researchers introduce RLSR, a reinforcement learning framework that trains smaller language models to rewrite source text for improved machine translation without manual prompt tuning. The approach achieves competitive performance with larger models across six MT systems and 16 language pairs, demonstrating that RL-optimized 4B parameter models can match capabilities of 235B parameter prompt-based systems.
AINeutralarXiv – CS AI · Jun 96/10
🧠AgriGov introduces a curated trilingual dataset (English-Hindi-Marathi) containing 8,000 parallel sentence pairs focused on Indian agricultural government schemes and farmer welfare programs. The dataset combines automated data collection, machine translation, and human post-editing to create domain-specific resources for machine translation, question-answering, and information retrieval systems aimed at farmer-facing applications.
AINeutralarXiv – CS AI · Jun 96/10
🧠Researchers developed a data synthesis methodology for neural machine translation of Q'eqchi' Mayan, using synthetic corpora derived from community dictionaries and Parameter-Efficient Fine-Tuning to avoid extractive web-scraping. While the approach achieved strong structural performance (BLEU 42.02 on synthetic data), it revealed a critical gap: the model excels at learning grammar but fails to acquire authentic semantic grounding (BLEU 0.59 on organic text), suggesting synthetic bootstrapping alone cannot replace real-world linguistic diversity.
AIBullisharXiv – CS AI · Jun 56/10
🧠Researchers propose a novel coreference resolution pipeline that uses machine translation and cycle-consistency validation to improve NLP performance in low-resource languages. By translating English training data to target languages and back-translating to verify quality, the approach generates weighted training samples that significantly enhance coreference resolution accuracy, even enabling resolution in languages without existing corpora.
AINeutralarXiv – CS AI · Jun 56/10
🧠Researchers have developed a multi-aspect iterative framework for improving literary translation using specialized LLMs and reinforcement learning. Their resulting models achieve competitive performance with Claude Sonnet 4.5 on English-to-Chinese literary translation benchmarks while demonstrating strong generalization to out-of-domain works.
🧠 Claude🧠 Sonnet
AINeutralarXiv – CS AI · Jun 16/10
🧠Researchers demonstrate that GPT-4o-generated paraphrases can improve sign language translation by augmenting training data while keeping video inputs unchanged. Testing across three sign language datasets reveals modest gains on PHOENIX14T (9.56 to 10.33 BLEU-4) but exposes fundamental limitations when data is sparse or highly controlled.
🧠 GPT-4
AINeutralarXiv – CS AI · May 296/10
🧠Researchers introduce Source-Grounded Semantic Reinforcement Learning (SG-SRL), a framework that leverages abundant source-language monolingual data to improve low-resource target-language generation through cross-lingual semantic rewards. The approach demonstrates significant gains in semantic grounding and factual coverage while maintaining fluency through a lightweight recovery stage.
AIBullisharXiv – CS AI · May 296/10
🧠Researchers introduce Loong, an AI agent designed to improve long document translation by selectively retrieving relevant context from a 3E memory module rather than processing all available information. The system uses reinforcement learning to optimize context selection and demonstrates significant translation quality improvements across multiple language pairs, achieving gains up to 13 points on standard evaluation metrics.
AINeutralarXiv – CS AI · May 286/10
🧠Researchers developed methods to preserve gender information in English-to-Hindi machine translation, a challenge caused by Hindi's ergative and honorific grammatical structures. Two inference-time interventions—Source-Aware Reranker and Phenomenon-Aware Reranker—significantly improved gender preservation but revealed a tradeoff between cultural fidelity and translation fluency.
🧠 GPT-4
AIBullisharXiv – CS AI · May 286/10
🧠Researchers present a method for aggressively pruning expert modules from mixture-of-experts large language models to create specialized translation systems. The approach removes up to 90% of experts with minimal performance degradation, demonstrating that translation tasks require only a fraction of a full LLM's parameters, enabling substantial model compression.
AINeutralarXiv – CS AI · Apr 206/10
🧠Researchers introduce CLewR, a curriculum learning strategy that improves machine translation performance in large language models by reordering training data from easy to hard examples with periodic restarts. The approach demonstrates consistent improvements across multiple model families and preference optimization techniques, addressing a previously underexplored aspect of LLM training methodology.
🧠 Llama
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers identified systematic reasoning errors in machine translation systems across seven language pairs, finding that while these errors can be detected with high precision in some languages like Urdu, correcting them produces minimal improvements in translation quality. This suggests that reasoning traces in neural machine translation models lack genuine faithfulness to their outputs, raising questions about the reliability of reasoning-based approaches in translation systems.
AINeutralarXiv – CS AI · Apr 146/10
🧠Researchers introduce a Cross-Lingual Mapping Task during LLM pre-training to improve multilingual performance across languages with varying data availability. The method achieves significant improvements in machine translation, cross-lingual question answering, and multilingual understanding without requiring extensive parallel data.
AINeutralarXiv – CS AI · Apr 106/10
🧠Researchers evaluated how well large language models can perform formal grammar-based translation tasks using in-context learning, finding that LLM translation accuracy degrades significantly with grammar complexity and sentence length. The study identifies specific failure modes including vocabulary hallucination and untranslated source words, revealing fundamental limitations in LLMs' ability to apply formal grammatical rules to translation tasks.
AINeutralarXiv – CS AI · Mar 126/10
🧠Researchers introduce DIBJudge, a new framework to address systematic bias in large language models that favor machine-translated text over human-authored content in multilingual evaluations. The solution uses variational information compression to isolate bias factors and improve LLM judgment accuracy across languages.
AIBearisharXiv – CS AI · Mar 36/104
🧠A new research study analyzes how Large Language Models are impacting Wikipedia content and structure, finding approximately 1% influence in certain categories. The research warns of potential risks to AI benchmarks and natural language processing tasks if Wikipedia becomes contaminated by LLM-generated content.
AINeutralarXiv – CS AI · Mar 264/10
🧠Researchers developed Konkani LLM, a specialized language model for the low-resource Indian language Konkani, using a synthetic 100k instruction dataset. The model addresses training data scarcity across multiple scripts (Devanagari, Romi, Kannada) and demonstrates competitive performance against proprietary models in machine translation tasks.
🧠 Gemini🧠 Llama
AINeutralarXiv – CS AI · Mar 124/10
🧠Researchers developed an automated framework to evaluate Large Language Models' effectiveness in translating Mandarin Chinese to English, comparing GPT-4, GPT-4o, and DeepSeek against Google Translate. While LLMs performed well on news translation, they showed varying results with literary texts, with DeepSeek excelling at cultural subtleties and GPT-4o/DeepSeek better at semantic conservation.
🏢 Meta🧠 GPT-4
