y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#arabic-ai News & Analysis

4 articles tagged with #arabic-ai. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles
AINeutralarXiv – CS AI · Mar 66/10
🧠

SalamahBench: Toward Standardized Safety Evaluation for Arabic Language Models

Researchers introduce SalamaBench, the first comprehensive safety benchmark for Arabic Language Models, evaluating 5 state-of-the-art models across 8,170 prompts in 12 safety categories. The study reveals significant safety vulnerabilities in current Arabic AI models, with substantial variation in safety alignment across different harm domains.

AIBullishHugging Face Blog · Aug 16/107
🧠

📚 3LM: A Benchmark for Arabic LLMs in STEM and Code

3LM introduces a new benchmark specifically designed to evaluate Arabic Large Language Models (LLMs) in STEM subjects and coding tasks. This benchmark addresses the gap in Arabic language evaluation tools for technical domains, providing a standardized way to assess AI model performance in Arabic scientific and programming contexts.

AINeutralHugging Face Blog · Jan 274/105
🧠

Alyah ⭐️: Toward Robust Evaluation of Emirati Dialect Capabilities in Arabic LLMs

Alyah is a new evaluation framework designed to assess the capabilities of Arabic Large Language Models (LLMs) specifically for the Emirati dialect. This research addresses the need for robust testing of AI language models in regional Arabic variants, which is crucial for developing more accurate and culturally appropriate Arabic AI systems.