y0news
AnalyticsDigestsSourcesTopicsRSSAICrypto

#arabic-ai News & Analysis

4 articles tagged with #arabic-ai. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

4 articles
AINeutralarXiv โ€“ CS AI ยท Mar 66/10
๐Ÿง 

SalamahBench: Toward Standardized Safety Evaluation for Arabic Language Models

Researchers introduce SalamaBench, the first comprehensive safety benchmark for Arabic Language Models, evaluating 5 state-of-the-art models across 8,170 prompts in 12 safety categories. The study reveals significant safety vulnerabilities in current Arabic AI models, with substantial variation in safety alignment across different harm domains.

AIBullishHugging Face Blog ยท Aug 16/107
๐Ÿง 

๐Ÿ“š 3LM: A Benchmark for Arabic LLMs in STEM and Code

3LM introduces a new benchmark specifically designed to evaluate Arabic Large Language Models (LLMs) in STEM subjects and coding tasks. This benchmark addresses the gap in Arabic language evaluation tools for technical domains, providing a standardized way to assess AI model performance in Arabic scientific and programming contexts.

AINeutralHugging Face Blog ยท Jan 274/105
๐Ÿง 

Alyah โญ๏ธ: Toward Robust Evaluation of Emirati Dialect Capabilities in Arabic LLMs

Alyah is a new evaluation framework designed to assess the capabilities of Arabic Large Language Models (LLMs) specifically for the Emirati dialect. This research addresses the need for robust testing of AI language models in regional Arabic variants, which is crucial for developing more accurate and culturally appropriate Arabic AI systems.