Artificial intelligence powering education: ChatGPT's impact on students' academic performance through the lens of technology-to-performance chain theory

Abstract

Purpose

In the context of rapid technological progress, this study investigates the factors that improve the academic performance of Saudi Arabian university students when they use ChatGPT. Using the technology-to-performance chain theory as a framework, this study identifies the variables that may affect the students' academic performance, thereby contributing to the discourse on the use of technology in education.

Design/methodology/approach

A survey is conducted on 257 respondents, and an online questionnaire is used to collect the data. Analysis of Moment Structures (AMOS) is employed to analyse the structural model to determine the direct connections between the different elements.

Findings

Findings reveal that task characteristics, technology characteristics and individual characteristics can significantly impact task-technology fit. Furthermore, task-technology fit can influence the utilisation of ChatGPT and students' academic performance. In addition, utilisation can significantly impact students' academic performance. Students are likely to utilise ChatGPT efficiently and demonstrate improved academic performance when they believe that the technology is a good fit for their tasks.

Research limitations/implications

This study’s shortcoming is its exclusive focus on a single public university in Saudi Arabia, which limits its generalisability. Comparative studies among multiple universities in Saudi Arabia and in other Gulf nations should be conducted to enhance the generalisability of the results. In addition, diversifying the participants by including students from various universities and exploring the moderating variables would deepen our understanding of the utilisation of ChatGPT by students.

Practical implications

The practical implications of this study include the existence of a positive relationship between task characteristics and task-technology fit, which can guide organisations in aligning ChatGPT with specific activities for enhanced efficacy and workflow integration. In addition, understanding the association between technology characteristics and task-technology fit can help in selecting suitable technologies that will encourage user adoption and improve academic outcomes. Furthermore, the recognition of the impact of individual characteristics on task-technology fit and their utilisation can inform tailored support and training programmes to enhance user acceptance and utilisation of ChatGPT, particularly in educational settings such as those in Saudi Arabia, which will ultimately improve students’ academic performance.

Originality/value

This study’s focus on ChatGPT and how it affects the academic performance of Saudi Arabian university students distinguishes it from previous studies. This study provides insightful information on technology adoption in educational settings and contributes to our understanding of the factors that can impact academic performance through ChatGPT adoption by utilising technology-to-performance chain theory. Moreover, this study’s examination of task characteristics, technology characteristics and individual characteristics can significantly enrich discussions on optimal technology integration for educational objectives. This contribution is relevant in dynamic contexts, such as the rapidly evolving technological environment of Saudi Arabia.

Citation

Al-Mamary, Y.H., Alfalah, A.A., Shamsuddin, A. and Abubakar, A.A. (2024), "Artificial intelligence powering education: ChatGPT's impact on students' academic performance through the lens of technology-to-performance chain theory", Journal of Applied Research in Higher Education, Vol. ahead-of-print No. ahead-of-print. https://doi.org/10.1108/JARHE-04-2024-0179