An explainable attention-based bidirectional GRU model for pedagogical classification of MOOCs
Interactive Technology and Smart Education
Article publication date: 6 September 2022
Issue publication date: 27 October 2022
The purpose of this study is, First, to leverage the limitation of annotated data and to identify the cognitive level of learning objectives efficiently, this study adopts transfer learning by using word2vec and a bidirectional gated recurrent units (GRU) that can fully take into account the context and improves the classification of the model. This study adds a layer based on attention mechanism (AM), which captures the context vector and gives keywords higher weight for text classification. Second, this study explains the authors’ model’s results with local interpretable model-agnostic explanations (LIME).
Bloom's taxonomy levels of cognition are commonly used as a reference standard for identifying e-learning contents. Many action verbs in Bloom's taxonomy, however, overlap at different levels of the hierarchy, causing uncertainty regarding the cognitive level expected. Some studies have looked into the cognitive classification of e-learning content but none has looked into learning objectives. On the other hand, most of these research papers just adopt classical machine learning algorithms. The main constraint of this study is the availability of annotated learning objectives data sets. This study managed to build a data set of 2,400 learning objectives, but this size remains limited.
This study’s experiments show that the proposed model achieves highest scores of accuracy: 90.62%, F1-score and loss. The proposed model succeeds in classifying learning objectives, which contain ambiguous verb from the Bloom’s taxonomy action verbs, while the same model without the attention layer fails. This study’s LIME explainer aids in visualizing the most essential features of the text, which contributes to justifying the final classification.
In this study, the main objective is to propose a model that outperforms the baseline models for learning objectives classification based on the six cognitive levels of Bloom's taxonomy. In this sense, this study builds the bidirectional GRU (BiGRU)-attention model based on the combination of the BiGRU algorithm with the AM. This study feeds the architecture with word2vec embeddings. To prove the effectiveness of the proposed model, this study compares it with four classical machine learning algorithms that are widely used for the cognitive classification of text: Bayes naive, logistic regression, support vector machine and K-nearest neighbors and with GRU. The main constraint related to this study is the absence of annotated data; there is no annotated learning objective data set based on Bloom’s taxonomy's cognitive levels. To overcome this problem, this study seemed to have no choice but to build the data set.
Conflicts of interest/competing interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Data availability statement: Data available on request. The data underlying this article will be shared on reasonable request to the corresponding author.
Consent for publication: I, the corresponding author of this paper, give my consent for the publication of identifiable details, which can include photograph (s) and/or videos and/or case history and/or details within the text (“material”) to be published in the above journal and article.
Availability of data and material: The data sets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Authors' contributions: All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Hanane SEBBAQ and Noureddine Elfaddouli. The first draft of the manuscript was written by Hanane SEBBAQ, and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Sebbaq, H. and El Faddouli, N.-e. (2022), "An explainable attention-based bidirectional GRU model for pedagogical classification of MOOCs", Interactive Technology and Smart Education, Vol. 19 No. 4, pp. 396-421. https://doi.org/10.1108/ITSE-10-2021-0188
Emerald Publishing Limited
Copyright © 2022, Emerald Publishing Limited