#arabic-nlp News & Analysis

8 articles tagged with #arabic-nlp. AI-curated summaries with sentiment analysis and key takeaways from 50+ sources.

8 articles

AINeutralarXiv – CS AI · Jun 236/10

🧠

Evaluation of Small Language Models for Arabic Language Processing

Researchers evaluated 12 small language models on Arabic NLP tasks using a 240-item benchmark across 8 domains, finding that Gemma 3 (12B) performed best despite model size alone not determining performance. The study reveals that Arabic alignment and instruction-following capability matter more than parameter count, with lower-performing models struggling with prompt leakage, hallucination, and language drift.

🧠 GPT-4🧠 Claude🧠 Haiku

AINeutralarXiv – CS AI · Jun 236/10

🧠

WASIL: In-the-Wild Arabic Spoken Interactions with LLMs

Researchers released WASIL, a dataset of 8,529 Arabic spoken interactions with LLMs including audio, transcriptions, and user feedback, to address how speech recognition errors degrade voice assistant performance. The dataset includes a 2,000-turn test set covering Modern Standard Arabic and four dialects, with annotations distinguishing between genuine unanswerability and ASR-induced failures, enabling more accurate evaluation of voice AI systems.

AINeutralarXiv – CS AI · Jun 195/10

🧠

A Comparative Study of Pretrained Transformer Models for Quranic ASR: Speech Representations, Label Formats, and Dataset Composition

Researchers developed improved Automatic Speech Recognition (ASR) models for Quranic recitation using pretrained Transformer architectures (Wav2Vec2.0, HuBERT, XLS-R), achieving 8% word error rates compared to 16.3% baseline performance. The study demonstrates that domain-specific fine-tuning with 870+ hours of professional and user-recited Quranic audio, combined with Arabic text without diacritics, significantly enhances transcription accuracy while reducing training time by 71%.

AINeutralarXiv – CS AI · Jun 106/10

🧠

Towards Robust Arabic Speech Emotion Recognition with Deep Learning

Researchers propose a CNN-Transformer hybrid architecture for Arabic Speech Emotion Recognition that achieves 98.1% accuracy, outperforming CNN-LSTM and fine-tuned wav2vec 2.0 models. The study addresses the underexplored challenge of emotion detection in Arabic speech by combining convolutional feature extraction with Transformer-based context modeling, demonstrating effectiveness in low-resource, dialectally diverse settings.

AINeutralarXiv – CS AI · May 46/10

🧠

Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues

Researchers introduce ArabCulture-Dialogue, a new dataset for evaluating large language models' cultural reasoning across 13 Arabic-speaking countries in both Modern Standard Arabic and regional dialects. Benchmarking reveals significant performance gaps, with LLMs consistently underperforming on dialectal Arabic compared to standardized variants, highlighting a critical blind spot in AI language model training.

AINeutralarXiv – CS AI · Apr 206/10

🧠

Beyond MCQ: An Open-Ended Arabic Cultural QA Benchmark with Dialect Variants

Researchers have created the first comprehensive Arabic Cultural QA benchmark that translates questions across Modern Standard Arabic and regional dialects, converting multiple-choice questions into open-ended formats. Testing reveals that large language models significantly underperform on dialectal content and struggle with open-ended Arabic questions, highlighting critical gaps in culturally grounded language understanding.

AIBullishHugging Face Blog · Aug 16/107

🧠

📚 3LM: A Benchmark for Arabic LLMs in STEM and Code

3LM introduces a new benchmark specifically designed to evaluate Arabic Large Language Models (LLMs) in STEM subjects and coding tasks. This benchmark addresses the gap in Arabic language evaluation tools for technical domains, providing a standardized way to assess AI model performance in Arabic scientific and programming contexts.

AINeutralarXiv – CS AI · Mar 124/10

🧠

GATech at AbjadMed: Bidirectional Encoders vs. Causal Decoders: Insights from 82-Class Arabic Medical Classification

GATech researchers compared bidirectional encoders versus causal decoders for Arabic medical text classification across 82 categories, finding that specialized bidirectional encoders like AraBERTv2 significantly outperform large language models. The study demonstrates that causal decoders optimized for next-token prediction produce sequence-biased embeddings less effective for precise categorization tasks.

🧠 Llama