Measuring Large Language Models Dependency: Validating the Arabic Version of the LLM-D12 Scale
By: Sameha AlShakhsi , Ala Yankouskaya , Magnus Liebherr and more
Potential Business Impact:
Measures how people trust and use AI.
There is an urgent need for reliable, culturally validated instruments to assess psychological responses to AI in general and large language models (LLMs). This need is global issue, but it is especially urgent among Arabic-speaking populations, where AI and LLMs adoption is accelerating, yet psychometric tools remain limited. This study presents the first validation of the LLM-D12, a dual-dimensional scale assessing Instrumental and Relationship Dependency on LLMs, in an Arab sample. A total of 250 Arab participants completed the Arabic version of the LLM-D12. Confirmatory Factor Analysis confirms the original 2-factor structure of LLM-D12 with all items showing good loading of corresponding Instrumental and Relationship Dependency. The scale showed good to excellent internal reliability (Cronbach alpha is 0.90 for Total, 0.85 for Instrumental Dependency, and 0.90 for Relationship Dependency). External validation revealed that Instrumental Dependency was positively associated with AI acceptance and internet addiction, while Relationship Dependency was linked to lower need for cognition and greater trustworthiness of LLM, demonstrating sensitivity of this instrument to different use and personal factors. These findings confirm that Arabic LLM-D12 is a psychometrically sound, culturally appropriate instrument, offering a necessary tool for research, education, and policy concerning AI and LLMs engagement in Arab contexts.
Similar Papers
LLM-D12: A Dual-Dimensional Scale of Instrumental and Relational Dependencies on Large Language Models
Human-Computer Interaction
Measures how much people rely on AI friends.
Developing and Validating the Arabic Version of the Attitudes Toward Large Language Models Scale
Human-Computer Interaction
Measures how Arabs feel about AI chatbots.
UI-Level Evaluation of ALLaM 34B: Measuring an Arabic-Centric LLM via HUMAIN Chat
Computation and Language
Helps computers understand and speak Arabic better.