#knowledge-evaluation News & Analysis

3 articles tagged with #knowledge-evaluation. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

3 articles

AINeutralarXiv – CS AI · Apr 147/10

🧠

LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMs

Researchers introduce LiveCLKTBench, an automated benchmark for evaluating how well multilingual large language models transfer knowledge across languages, addressing the challenge of distinguishing genuine cross-lingual transfer from pre-training artifacts. Testing across five languages reveals that transfer effectiveness depends heavily on linguistic distance, model scale, and domain, with improvements plateauing in larger models.

AINeutralarXiv – CS AI · Jun 46/10

🧠

Knowledge Index of Noah's Ark

Researchers introduce KINA, a new 899-item benchmark for evaluating large language models across 261 disciplines, addressing methodological issues in existing knowledge benchmarks. The study evaluates 42 models with formal guarantees on representativeness and ranking stability, revealing a tiered performance structure with Gemini-3.1-Pro-Preview leading at 53.17% accuracy.

🧠 GPT-5🧠 Claude🧠 Gemini

AINeutralarXiv – CS AI · Jun 16/10

🧠

KnowledgeGain: Evaluating and Optimizing Science News Generation for Reader Learning

Researchers introduce KnowledgeGain, a metric that evaluates science news quality by measuring reader learning rather than semantic similarity. Validated through human studies, the metric uses an LLM reader simulator to identify articles that improve post-reading comprehension and knowledge retention aligned with Bloom's Taxonomy.