PalmX 2025

Objective

The objective of this subtask is to evaluate the ability of large language models to comprehend and reason about the diverse aspects of Arabic general culture. This includes traditional customs, local etiquette, cuisine, historical events, famous figures, geography, arts, and dialectal expressions across different Arab countries. The subtask challenges models to accurately select culturally appropriate answers from multiple-choice questions written in both Modern Standard Arabic, thereby testing their cultural grounding and contextual understanding.

Objective

This subtask aims to assess language models' understanding of key elements of Islamic culture, which plays a foundational role in Arabic societies. It covers topics such as Islamic rituals and practices (e.g., prayers and fasting), Quranic knowledge, Hadith literature, historical developments in Islam, and religious holidays. Models are expected to answer multiple-choice questions that reflect both religious literacy and contextual sensitivity, ensuring their ability to handle culturally and theologically significant content with accuracy and respect.