y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#cross-lingual-nlp News & Analysis

3 articles tagged with #cross-lingual-nlp. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles
AINeutralarXiv – CS AI · Jun 236/10
🧠

BabelJudge: Measuring LLM-as-a-Judge Reliability Across Languages and Agent Trajectories

Researchers introduce BabelJudge, an open-source framework that audits LLM-as-a-judge systems for systematic biases including position bias, verbosity bias, and cross-lingual degradation. The benchmark reveals significant reliability gaps across languages, with performance dropping from 0.714 in Hindi to 0.550 in Swahili, and extends evaluation to agentic AI systems through trajectory-level perturbations.

AINeutralarXiv – CS AI · Jun 236/10
🧠

Orthogonal Representation Editing: Decoupling Semantic Entanglement in Batch Knowledge Editing of LLMs

Researchers propose Orthogonal Representation Editing (ORE), a novel method for efficiently updating factual knowledge in Large Language Models without full retraining. The technique addresses a critical limitation in batch knowledge editing by decoupling semantic representation entanglement through orthogonal constraints, demonstrating superior performance including cross-lingual capabilities.

AINeutralarXiv – CS AI · Jun 26/10
🧠

Understanding LLM Behavior in Multi-Target Cross-Lingual Summarization

Researchers introduce MEA, a new benchmark for multi-target cross-lingual summarization (MTXLS) covering 24 languages, and reveal that LLMs perform this task substantially worse than English monolingual summarization. A novel layer-wise analysis shows that translation and summarization behaviors emerge jointly in later layers rather than as separate stages, enabling a new activation steering method that improves MTXLS quality across languages.