Comparison of the effectiveness of project-based 6E learning and problem-based quantum learning: Solomon four-group design

Şeyma Şahin (Ministry of National Education, Duzce, Turkey)
Abdurrahman Kılıç (Düzce University, Duzce, Turkey)

Journal of Research in Innovative Teaching & Learning

ISSN: 2397-7604

Article publication date: 12 March 2024

176

Abstract

Purpose

Researchers have previously utilized the project-based 6E learning model and the problem-based quantum learning model in various courses, such as the instructional principles and methods course and the character and values education course. These models were evaluated for their impact on students in different subjects, including developing skills, values, democracy perceptions, attitudes towards cooperative learning, metacognitive thinking skills and teacher self-efficacy perceptions. In 2023, Ökmen, Sahin and Kiliç reported positive outcomes, while Sahin and Kiliç reported similar findings in 2023a, 2023b and 2023c. There has been no investigation into how the models affect students' critical thinking and academic literacy. This study seeks to determine the impact of both models on these skills, gain more insight into their effectiveness and determine which is more beneficial. The results will guide the decision-making process for the character and values education course and other courses in the future. Specifically, this research aims to compare the effects of the project-based 6E learning model and problem-based quantum learning model on critical thinking and academic literacy.

Design/methodology/approach

This research employed the Solomon four-group experimental design to assess the efficacy of the applications. Prior knowledge and experience of the participants were evaluated through pretests. However, it should be noted that pretests may impact posttest scores either positively or negatively. For instance, participants taking the test multiple times may become more interested or attentive to the subject matter. The Solomon four-group design was deemed appropriate to analyze the influence of pretesting. This design enables the investigation of the application effect, pretest effect and interactive effect of pretest and application (van Engelenburg, 1999).

Findings

It was concluded that the project-based 6E learning model was effective in developing critical thinking in students, but not significantly. It was concluded that the problem-based quantum learning model significantly improved students' critical thinking skills. It was concluded at the end of the study that the project-based 6E learning model notably enhanced students' academic literacy. It was concluded that the problem-based quantum learning model had a significant positive impact on students' academic literacy. According to research, it has been determined that the problem-based quantum learning model is superior in enhancing critical thinking abilities compared to the project-based 6E learning model. Nevertheless, there seems to be no detectable disparity in the academic literacy advancement of pupils between the problem-based quantum learning model and the project-based 6E learning model.

Originality/value

There has been no investigation into how the models affect students' critical thinking and academic literacy. This study seeks to determine the impact of both models on these skills, gain more insight into their effectiveness and determine which is more beneficial. The results will guide the decision-making process for the character and values education course and other courses in the future.

Keywords

Citation

Şahin, Ş. and Kılıç, A. (2024), "Comparison of the effectiveness of project-based 6E learning and problem-based quantum learning: Solomon four-group design", Journal of Research in Innovative Teaching & Learning, Vol. ahead-of-print No. ahead-of-print. https://doi.org/10.1108/JRIT-09-2023-0139

Publisher

:

Emerald Publishing Limited

Copyright © 2024, Şeyma Şahin and Abdurrahman Kılıç

License

Published in Journal of Research in Innovative Teaching & Learning. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


Introduction

In modern times, the approach to teaching has evolved and institutions that provide teacher training strive to include 21st-century skills in their programs. They also make necessary updates to ensure that qualified teachers are trained (Partnership for 21st Century Skills, 2010). The 21st-century skills consist of the knowledge, abilities and proficiency that students require to succeed in their daily lives and business ventures (Santos, 2017). These skills can be categorized into four main groups, which are: (1) methods of thinking (such as critical thinking, creativity, problem-solving, decision-making and metacognitive thinking), (2) Tools for work (such as information and communication technology literacy), (3) Methods of working (such as communication and collaboration) and (4) Ways of life (such as local and global citizenship, life and career, personal and social responsibility and cultural awareness) (Joynes et al., 2019).

Critical thinking is a vital skill for the 21st century, involving using rational standards to analyze and evaluate information, thoughts and situations. It aims to create new knowledge, understandings, hypotheses and beliefs, equipping individuals to make informed decisions, solve problems effectively and achieve the correct results (Heard et al., 2020). This skill encompasses a range of cognitive abilities, from processing information to identifying arguments, discovering biases and making reasonable decisions (Bassham et al., 2011). Developing critical thinking skills can lead to academic and business success, broaden one’s worldview and enhance the ability to make effective decisions and find direction in learning and life (Murawski, 2014). When thinking functions are not used correctly, emotions and desires can dominate thought, leading to personality degeneration into arrogance, injustice, bias, distrust, cowardice, selfishness and hypocrite. Therefore, critical thinking is an essential form of thinking that is necessary for one’s mental health (Şenşekerci and Bilgin, 2008).

Academic literacy encompasses critical thinking, reading, writing and communication, as well as the ability to manage and produce information (Doru, 2018). In addition to writing skills, academic literacy includes accessing, interpreting and evaluating information and creating new texts. Critical thinking ability is closely linked to academic literacy (Klalare et al., 2022). Developing advanced language skills and higher-order thinking is intricately tied to academic literacy. It is essential for knowledge creation and effective communication and is a critical component of language and cognitive growth. For this reason, academic literacy is widely recognized as a potent tool for promoting academic literacy development, facilitating knowledge production, driving communication and fostering transformation (Li, 2022). In the modern world, where vast information is at our fingertips, students must engage with texts effectively. They must approach these texts critically, carefully selecting those most valuable to their academic or research pursuits (Castillo-Martínez et al., 2023).

Although critical thinking is universally recognized as an essential skill for students to acquire, many struggle in this area. Educators often find students' thoughts superficial (Willingham, 2020). In an academic setting, students face challenges comprehending text, identifying its main idea, establishing connections between different parts, relating it to their prior knowledge, drafting, producing and using language appropriately (Pinheiro et al., 2016). The quality of education provided to students is crucial in developing critical thinking and academic literacy skills. The only way to enhance these competencies is to improve the quality of teaching (Kim et al., 2019).

Mastering critical thinking is a multifaceted journey that cannot be accomplished through a single course. Educators must create opportunities for students to develop these skills in all aspects of their lives (Şenşekerci and Bilgin, 2008). Nurturing critical thinking requires students to take ownership of their education and engage in the learning process proactively (Murawski, 2014). This necessitates employing higher-order cognitive abilities, as critical thinking is a cognitive practice that necessitates introspection. Learning environments that promote critical thinking entail scrutinizing, amalgamating and assessing information to solve problems and make decisions rather than simply committing facts to memory. To cultivate advanced thinking skills, teachers must employ pedagogical approaches that encourage reflection rather than methods that encourage rote learning. Lecturing and teaching techniques prioritizing memorization fail to adequately stimulate critical thinking, as they do not foster students' curiosity and analytical skills (Snyder and Snyder, 2008).

For students to cultivate sophisticated literacy skills, active engagement in purposeful and well-organized learning experiences that imbue meaning, values and emotion is imperative. Li’s (2022) research corroborates this approach, emphasizing the need for educators to design activities that stimulate students' rational thinking, inference-making, problem-solving and conclusion-drawing abilities across all levels of academia, from preschool to higher education. Weideman and van Dyk (2014) underscore the significance of such activities.

In order to prepare students with indispensable abilities like critical thinking and scholarly competence in the modern era, it is imperative to implement educational frameworks. Two highly recommended frameworks are the project-based 6E learning model and the problem-based quantum learning model, which will be briefly introduced below. The methodology section will offer a comprehensive breakdown of their implementation.

Project based 6E learning model

The learning cycle is a highly effective method that engages students in a series of planned and sequential learning stages, empowering them to construct their knowledge. This approach offers numerous benefits, including comprehending complex concepts, fostering a positive attitude toward the subject matter and refining students' reasoning and critical thinking skills.

The project-based 6E learning model combines the strengths of project-based learning and the learning cycle, making it suitable for various disciplines. In this model, students engage in a cyclical process that involves problem identification, research, analysis, data collection, data analysis, developing strategies for problem-solving and producing products. The model is well-structured and integrated with lessons, with individual, group and classroom activities at each step. The aim is to help students develop high-level thinking skills (Şahin and Kılıç, 2023a).

In a study conducted by Şahin and Kılıç (2023a), it was discovered that the project-based 6E learning model significantly improved students' research skills, including problem identification, data collection, analysis, inference, reporting and presentation. Additionally, the model enhanced students' ability to work collaboratively, fostered positive attitudes toward group work and improved their self-control skills. Moreover, the students reported finding the learning model to be productive and effective, exciting and enjoyable.

Problem based quantum learning model

The Problem-Based Learning method is highly effective, aligns well with the constructivism theory, and equips students with crucial skills. Its benefits include improvements in problem-solving, creative and critical thinking, and overall academic performance. Meanwhile, the quantum learning model seeks to impart academic and life skills to students. This model encourages active participation in the learning process and instills a sense of responsibility in learners. Academic skills taught include quantum note-taking, memory, writing and reading techniques. Additionally, life skills taught include problem-solving, leadership, self-efficacy, responsibility and communication. By combining the steps of problem-based learning and the quantum learning cycle, the problem-based quantum learning model aims to develop students' problem-solving, creative thinking, critical thinking, academic and life skills (Ökmen et al., 2023).

The problem-based quantum learning model positively impacted students' perception of their teachers' teaching abilities and their ability to learn the course material. The model’s effectiveness was demonstrated through research, interdisciplinary connections and diligent effort on the part of the students, resulting in greater productivity and improved retention of information. In addition, the model was found to be engaging and increased students' motivation to learn, according to Ökmen et al. (2023).

Purpose of the research

The “project-based 6E learning model” is an innovative approach to learning that combines the best features of project-based and learning cycle models. It aims to help students in problem identification, research, investigation, data collection, data analysis, developing various strategies for solving the problem and producing products in a cyclical process. The steps are effectively structured and integrated with the course to ensure comprehensive learning. Additionally, the researchers combined the steps of the problem-based learning method with the quantum learning cycle to create a problem-based quantum learning model. This model effectively helps students in developing problem-solving, self-efficacy and thinking skills.

Researchers have previously utilized the project-based 6E learning model and the problem-based quantum learning model in various courses, such as the instructional principles and methods course and the character and values education course. These models were evaluated for their impact on students in different subjects, including developing skills, values, democracy perceptions, attitudes towards cooperative learning, metacognitive thinking skills and teacher self-efficacy perceptions. In 2023, Ökmen, Şahin and Kılıç reported positive outcomes, while Şahin and Kılıç reported similar findings in 2023a, 2023b and 2023c.

There has been no investigation into how the models affect students' critical thinking and academic literacy. This study seeks to determine the impact of both models on these skills, gain more insight into their effectiveness and determine which is more beneficial. The results will guide the decision-making process for the character and values education course and other courses in the future. Specifically, this research aims to compare the effects of the project-based 6E learning model and problem-based quantum learning model on critical thinking and academic literacy.

Method

Research design

This research employed the Solomon four-group experimental design to assess the efficacy of the applications. The prior knowledge and experience of the participants were evaluated through pretests. However, pretests can cause “pretest sensitivity,” affecting posttest scores. Pretest sensitization is a phenomenon that occurs when a participant’s performance on a posttest is influenced by taking a pretest, even if the participant has not been exposed to the experimental treatment or manipulation being examined. This can lead to incorrect conclusions about the effectiveness of an experiment and bias the results (Solomon, 1949). The Solomon four-group design was deemed appropriate to analyze the influence of pretesting. This design enables the investigation of the application effect, pretest effect and interactive effect of pretest and application (van Engelenburg, 1999). The study’s experimental design is detailed in Table 1.

Based on the data presented in Table 1, there are four groups involved in the study – two experimental and two control groups. One experimental and one control group underwent a pretest while the other two did not. Specifically, the Mathematics and special education groups took the pretest, while the English and Turkish groups did not. End of the semester, all groups took a posttest (O2, O4, O5, O6). Group 1 (Math) and Group 3 (English) used the project-based 6E learning model (X1), while Group 2 (Special Education) and Group 4 (Turkish) utilized the problem-based quantum learning model (X2).

The students in each department took the elective course “Character and Values Education.” Due to the impossibility of randomly assigning individual students to different groups, groups were randomly assigned to the experimental and control groups.

Sample group

The research involved 173 students in the “Character and Values Education” course during the fall semester of 2022–2023 at a state university’s education faculty. The number of students included in the sample is presented in Table 2.

The third-year students who are studying Mathematics, English and Turkish have all successfully completed the same educational science courses. Furthermore, the fourth-year students who are pursuing special education have performed equally well as their peers in the pretest with regards to academic literacy and critical thinking. Therefore, it is assumed that all groups are beginning the program with the same level of knowledge and skills.

Implementation process

The research ethics committee report was approved by the Scientific Research and Publication Ethics Committee of Duzce University on February 27, 2023, with the decision number E-78187535-050.06-268915.

The Character and Values Education course was a 14-week program that began with an introductory week where students were given an overview of the course and the pretests were conducted to assess the student’s knowledge. The two models were then applied over the next 12 weeks, and in the program’s final week, evaluations were carried out and final tests were administered to the students. Each group was led by the same faculty member throughout the entire course.

The study employed a collaborative approach, wherein 4 to 7 members were divided into experimental and control groups. Each group was assigned a leader to supervise the work for two weeks, and all members took turns in this role. To make it easier to keep track of files and assignments, all groups created a Google Classroom account using a shared email address.

During the semester, we covered six different topics, each lasting for two weeks. These topics included basic concepts, classification and formation of values, the historical process of values education, the interplay between family and values, the influence of environment on values, the role of curriculum in values education and approaches, models and methods for values education. The semester ended with a focus on the professional responsibilities of teachers.

Our weekly routine was divided into three parts: individual work, group work and class work. Each member completed their studies individually before coming together for the group study. The group study was conducted using a method agreed upon by the group, such as face-to-face meetings, Zoom calls or WhatsApp chats, at a predetermined time. Finally, the class study took place at specific times for each group. Group 1 had face-to-face meetings every Wednesday from 8:30–10:00, Group 2 met every Tuesday from 8:30–10:00, Group 3 met every Wednesday from 10:10–11:40 and Group 4 met every Thursday from 8:30–10:00.

The study implemented the project-based 6E learning model for the experimental groups in Math and English and the problem-based quantum learning model for the control groups in special education and Turkish. Details for both models are explained below.

Project-based 6E learning

1st week

Individual Studies: The learning materials related to the subject were shared with the students via Google Classroom to grab their attention and assess their prior knowledge. The aim was to provide them with new information on the subject. Students were required to analyze the materials and answer two questions: “What did I learn about this topic?” and “What can I learn differently?”. Based on the results of the analysis, they were expected to gather additional information from various sources and include it in their report.

Group studies: As a group, the students identified a common problem situation based on their studies. They then collected data by utilizing various data sources and data collection tools that matched the structure of the identified problem. The students analyzed the collected data as a group, drew various conclusions and generated ideas for solutions to reach a decision.

Classroom studies: During their presentation, the students shared their understanding and perspectives of the concepts, as well as their experiences in the problem-solving process. They also presented the solutions they came up with, the results they achieved and their recommendations for improvement. After each presentation, the students evaluated each group separately and sent their feedback to the group leader.

2nd week

Individual studies: Each student contributed new problems related to the first week’s situation based on their experiences.

Group studies: The students provided individual suggestions to identify a common problem situation. The results from the previous problem analysis were applied to this new problem situation. The stages of collecting and analyzing new data were carried out for this new problem, which led to reaching conclusions and generating ideas for its solution. Finally, recommendations and mutual results for the first and second weeks were achieved and reported.

Classroom studies: During the learning process, the students shared their experiences, gained knowledge and perceptions about various concepts, and presented their results and solution proposals. They evaluated each other’s presentations and sent their reviews to the group leader. At the end of the class, the lecturer gave feedback on the presentations and the reports were updated accordingly. Each group prepared a report every two weeks and uploaded it to Google Classroom as a Word file. The head of the group was responsible for organizing and sending the file.

Problem-based quantum learning

1st week

Individual studies: The students interpreted the given materials (scenario, situation, video, article, etc.) relating to their preliminary knowledge using the techniques outlined in the unit manual and then reported.

Group studies: The students worked together on materials that were individually interpreted. They identified problems and then determined the necessary information needed to solve them using techniques outlined in the unit manual, such as classification, writing slogans and mind mapping. After that, they reported their findings.

Classroom studies: The students presented their group report to the class and then completed the “They Have It, We Don’t Have It” form while listening to other groups' presentations.

2nd week

Individual studies: The students collected the required data to resolve the issue. They then carried out a range of activities, including concept mapping, letter writing, memoir writing and summary writing using the Cornell technique, preparing a structured grid and creating a puzzle, as per the instructions given in the unit manual. Finally, they presented their findings on all of the activities they had accomplished.

Group studies: The students completed various activities in the unit manual based on their research. These activities included opposite panels, acrostic writing, fishbone preparation, story writing, circle technique, six hats thinking technique, article and curriculum review, snowball technique, work plan preparation, argumentation and drama writing. As a result, the students were able to come up with at least two solutions related to other disciplines using the information they gathered. They also reported on all of their completed work.

Classroom studies: The students presented their reports to the class, and completed a peer evaluation form while listening to other groups' presentations.

Data collection

For our data collection, we used two scales: the critical thinking tendency scale and the academic literacy scale. The critical thinking tendency scale, developed by Semerci (2016), has a total of 49 items and explains 49.16% of the variance. This scale has a test-retest correlation of 0.761 and a Cronbach Alpha coefficient of 0.963. The academic literacy scale, created by Demir and Deniz (2020), has 23 items and explains 41.13% of the variance. This scale has a Cronbach Alpha coefficient of 0.87.

Data was collected voluntarily via Google Form at the beginning (03-11/10/2022) and end (17-23/01/2023) of the semester.

Analysis of data

As part of the analysis phase, we performed an initial evaluation of the data. We discovered that there were no missing values, but we did exclude observations that were all rated with a five and not taken seriously. Following that, we examined the Z scores to identify any extreme values, and removed any observations with a score above three from the analysis.

The data was tested for normality using Kolmogorov–Smirnov (n > 30) and Shapiro–Wilk (n < 30) tests. The results are presented in Table 3.

According to Table 3, the only significant posttest scores were in the special education category for the critical thinking tendency scale (p < 0.05). However, after evaluating the skewness and kurtosis values of the scores, it was concluded that the skewness value was 0.277 and the kurtosis value was −0.997. If the coefficient of skewness is within −1 and +1, it is considered that the distribution is normal. Moreover, kurtosis values below 2 indicate a normal distribution (Watkins, 2021). Thus, the posttest scores for special education are normally distributed. Similarly, the pretest and posttest scores for the academic literacy scale exhibit normal distributions too.

As the number of students in the Mathematics (66), Special Education (43) and Turkish (39) groups exceeds 30, and the groups exhibit normal distribution, it is appropriate to conduct parametric tests. Although the number of students in the English group (25) is slightly below 30, parametric tests can be applied since the number of subjects is n ≥ 10 and the group exhibits normal distribution (Sümbüloğlu and Sümbüloğlu, 2007).

In the data analysis, the flow chart suggested by Walton Braver and Braver (1988) was used, and the analyses were carried out in this order. An analysis was done on the posttest scores of four groups (O2, O4, O5, O6) using the 2 × 2 ANOVA (Test A) for critical thinking tendency scale and academic literacy scale. The data was checked to ensure it met the requirements for the analysis. Three assumptions were considered: (1) Observations are independent of each other, (2) The dependent variable’s measurements follow a normal distribution, (3) The groups being observed have equal variances.

Since each student was included in just one group, the assumption of independence was met. Additionally, it was found that the posttest scores for both scales followed a normal distribution. The homogeneity of variances was tested using Levene’s test, and the results for both scales were insignificant (critical thinking tendency scale: p = 0.107, academic literacy scale: p = 0.145), indicating that the variances were homogeneous. Once the prerequisites were met, the 2 × 2 ANOVA analyses were performed, and it was found that the interaction was insignificant for both scales. The analyses continued without any issues.

We conducted a basic effect test (Test D) on the posttest scores of groups O2, O4, O5, and O6. This involved testing the effect of the “method” on both the critical thinking tendency scale and the academic literacy scale. We found that the method had a significant main effect on the critical thinking tendency scale (p = 0.003), so we stopped the analysis there. However, on the academic literacy scale, the method’s main effect was not significant (p = 0.939), so we continued with further analyses.

An Analysis of Covariance (ANCOVA) was conducted on the scores of Group-1 and Group-2 (Test E) on academic literacy scale. Prior to analysis, it was ensured that the data met the necessary requirements. The ANCOVA analysis has five basic assumptions: (1) independence between observations, (2) normal distribution of dependent variable measurements, (3) equal variance within their respective groups, (4) linearity, (5) equality of intragroup regression coefficients.

Each student was assigned to only one group, thus meeting the assumption of independence between the groups. The academic literacy scale pretest and posttest scores were found to be normally distributed. Levene’s test was used to test the homogeneity of variances, and the result was insignificant, indicating that the variances were homogeneous. Correlation analysis revealed a linear relationship between the posttest scores (dependent variable) and the pretest scores (control variable), with a correlation coefficient (R = 0.515, p = 0.00) meeting the necessary condition for linearity (R ≥ 0.3). Finally, the regression slopes for each group were examined, and it was found that the joint effect of the pretest scores and the two different methods on the posttest scores was insignificant (method × pretest = 0.685 > 0.05). After ensuring that all prerequisites were met, ANCOVA analysis was conducted, and the interaction was found to be insignificant, allowing the analysis to continue.

An independent t-test (Test H) was conducted on the posttest scores of Group-3 and Group-4, who did not take the academic literacy scale pretest. The results showed that there was no significant difference between the experimental and control groups (p = 0.619), and the analysis continued.

Meta-analysis was performed with Stouffer’s Z method (Test I) to combine the ANCOVA result with the t-test result. The effect was found to be insignificant (p = 0.589), and the analysis was terminated.

Reliability

The Cronbach alpha reliability coefficients for the pretest and posttest of the measurement tools are given in Table 4.

Based on the data presented in Table 4, it is noted that the reliability coefficients fall within the range of 0.802–0.965. As per scholarly sources such as Coaley (2010) and Kline (1986), coefficients between 0.80 and 0.95 indicate a high-reliability level. It is observed that all the scales' pretest and posttest results demonstrate a high degree of reliability.

Results

In this section, the effects of the project-based 6E learning model and problem-based quantum learning model on students' critical thinking and academic literacy are examined.

Critical thinking

The mean scores for the pretest and posttest of the critical thinking tendency scale are presented in Table 5.

Table 5 shows that the special education pretest score was higher than Mathematics. During the posttest, Mathematics had the lowest score, while special education had the highest.

The results of the pretest and posttest for the critical thinking tendency scale are presented in Table 6.

Upon examining Table 6, it was found that there is no significant difference in the critical thinking tendency scale scores of students in Group-1 (t = −1.534, p = 0.131) in favor of the posttest. However, in Group-2 (t = −3.084, p = 0.004), there is a significant difference in favor of the posttest.

Additionally, the results of the 2 × 2 ANOVA test (Test-A) conducted on the critical thinking tendency scale posttest scores (O2, O4, O5 and O6) are presented in Table 7.

According to Table 7, the interaction between “pretest-method” was not significant (p = 0.216), indicating no effect on Critical Thinking Tendency Scale scores.

According to Table 7, test D shows that the method used (O2, O4, O5 and O6) has a significant effect (p = 0.003) on the critical thinking tendency scale. The results indicate that the problem-based quantum learning model is more effective than the project-based 6E learning model in developing critical thinking, based on the posttest scores.

Academic literacy

Table 8 displays the mean scores for the pretest and posttest of the academic literacy scale.

Table 8 shows a higher special education pretest score than Mathematics. In the posttest, English has the highest score and Mathematics has the lowest.

Table 9 displays the results of the t-test for the pretest and posttest of the academic literacy scale.

There was a significant difference in the academic literacy scale scores of students in Group-1 and Group-2 in favor of the posttest when examining Table 9 (t = −2.914, p = 0.005 and t = −2.629, p = 0.012, respectively).

The results of the 2 × 2 ANOVA test for the posttest scores of the academic literacy scale (O2, O4, O5 and O6) are shown in Table 10.

Table 10 shows that the “pretest-method” interaction has no significant effect (p = 0.487) on academic literacy scale scores.

As seen in Table 10, the study examined the effect of the method on academic literacy scale posttest scores (O2, O4, O5 and O6) using Test D. However, the result was not significant (p = 0.939).

An ANCOVA analysis (Test E) was conducted on the scores of Group-1 and Group-2 for the academic literacy scale. The results of the analysis are presented in Table 11.

According to Table 11, the difference in posttest scores between the groups was insignificant when controlling for pre-test scores in the ANCOVA analysis (p = 0.789).

An independent samples t-test was conducted on posttest scores (O5 and O6) of Group-3 and Group-4 on the academic literacy scale. The results of the analysis can be found in Table 12.

According to Table 12, the t-test result shows no significant difference between posttest scores of Group-3 and Group-4 (p = 0.619).

Stouffer’s Z method was used to combine ANCOVA and t-test results in a meta-analysis (Test I). However, the result was insignificant (Zmeta = 0.540, p = 0.589).

Upon thorough analysis, it was concluded that the academic literacy scale posttest scores were not improved by the method. Furthermore, there was no discernible difference in the effectiveness of the problem-based quantum learning model and the project-based 6E learning model in enhancing students' academic literacy skills.

Discussion and conclusions

It was concluded that the project-based 6E learning model was effective in developing critical thinking in students, though not significantly. Project-based learning is a highly effective teaching method that fosters higher-level and critical thinking skills in students (Aksela and Haatainen, 2018; Wahyuni, 2014). Through active participation in various stages of a project, students can shape their ideas and express their perspectives, which in turn enhance their critical thinking ability (Zoller, 1991). Several studies have indicated that the learning cycle can significantly improve students' reasoning and critical thinking abilities (Racheal, 2019; Sam et al., 2018). Therefore, the findings of this study align with the existing literature on this subject.

Şahin and Kılıç (2023a) conducted a study which showed that using the project-based 6E learning model helped improve students' research skills. This included their ability to identify problems, collect data, analyze information, draw conclusions, report their findings and make presentations. This finding supports the idea that critical thinking involves defining arguments, processing and assessing information, analyzing and evaluating situations, and making informed decisions, as explained by Bassham et al. (2011). Therefore, it can be concluded that these two research outcomes are compatible.

In a study conducted by Şahin and Kılıç (2023a), it was found that the project-based 6E learning model is effective in helping students to question and strengthen their values, as well as acquire new ones. Furthermore, another study by the same authors (Şahin and Kılıç, 2023c) showed that the model shifts students' perception of education from being centered on the teacher to being centered on the student. In a parallel study (Şahin and Kılıç, 2023b), it was concluded that the project-based 6E learning model has a positive impact on students' perception of democracy. All of these accomplishments are tied to the development of critical thinking skills in students. As a result, it can be inferred that modeling improves students' critical thinking abilities.

It has been concluded that the problem-based quantum learning model has a significant impact on improving students' critical thinking skills. Several studies have found that problem-based learning can enhance the critical thinking abilities of students (Duch et al., 2001; Purba et al., 2020; Seibert, 2021). Quantum learning is a teaching approach that aims to expand students' cognitive capacities. According to Johnson (2002), quantum learning involves “learning at the highest level of people’s thinking potential.” The results of this study are consistent with previous research. Ökmen et al. (2023) discovered that the problem-based quantum learning model positively impacted pre-service teachers' problem-solving, critical thinking, research and decision-making skills. These findings suggest that the problem-based quantum learning model is a useful tool for enhancing critical thinking skills.

At the conclusion of a study, it was found that the project-based 6E learning model significantly improved students' academic literacy. A study conducted by Şahin and Kılıç (2023a) demonstrated that this learning model helped students develop skills such as problem identification, data collection and analysis, inference, reporting and presentation. These findings suggest that implementing the project-based 6E learning model can be an effective way to boost students' academic literacy. Weideman and van Dyk (2014) argue that activities that encourage students to plan, infer, conclude and solve problems are critical for improving academic literacy at all educational levels. Based on this, it can be concluded that the activities involved in the project-based 6E learning model can effectively improve students' academic writing skills.

It has been concluded that the problem-based quantum learning model has a significant impact on improving students' academic literacy. According to Demir (2006), quantum learning model helps students to acquire academic literacy skills through various activities such as quantum note-taking, quantum memory, quantum writing and quantum reading. Li (2022) further explains that purposeful, structured and meaningful learning activities that are genuine and emotionally valuable can help students develop advanced literacy skills. Our research has discovered that the problem-based quantum learning model activities are highly effective in enhancing students' academic literacy skills. These activities include various techniques such as clustering, rapid writing, summary writing using the Cornell technique, letter writing, memoir writing, story writing, drama writing, acrostic writing, slogan writing, analysis, classification, mind mapping, concept map creation, fishbone preparation, structured grid preparation, puzzle preparation, opposite panel, circle technique, six hats thinking technique, snowball technique and argumentation.

Research has shown that the problem-based quantum learning model is better at improving critical thinking skills than the project-based 6E learning model. However, there doesn’t seem to be any noticeable difference in academic literacy development of students between the problem-based quantum learning model and the project-based 6E learning model.

Acquiring valuable competencies such as critical thinking and academic literacy is essential to improving the quality of teaching. Educators should design and facilitate experiences that enable students to develop and apply these skills to all aspects of their lives, irrespective of the level or subject. The problem-based quantum learning model and the project-based 6E learning model should be promoted and adopted by educators at all levels, ranging from early childhood to higher education. These models should be implemented in diverse subject areas and evaluated through rigorous research to ensure their effectiveness. Additionally, similar studies can be conducted across different educational institutions to compare and contrast the outcomes.

Solomon four group experimental design

GroupsPretestProcessPosttest
Group-1MathematicsO1X1O2
Group-2Special educationO3X2O4
Group-3English X1O5
Group-4Turkish X2O6

Note(s): X1: Project-Based 6E Learning, X2: Problem-Based Quantum Learning

Source(s): Table by authors

Research sample

GroupsGenderTotal
FemaleMale
Mathematics462066
Special education271643
English141125
Turkish30939
Total11756173

Source(s): Table by authors

Normality coefficients of data

ScalesGroupsp values
PretestPosttest
Critical thinking tendency scaleGroup-1Mathematics0.2000.200
Group-2Special Education0.2000.024
Group-3English 0.661
Group-4Turkish 0.200
Academic literacy scaleGroup-1Mathematics0.2000.095
Group-2Special Education0.2000.200
Group-3English 0.148
Group-4Turkish 0.200

Source(s): Table by authors

Reliability coefficients of measurement tools

ScalesGroupsp-values
PretestPosttest
Critical thinking tendency scaleGroup-1Mathematics0.9470.932
Group-2Special Education0.9560.964
Group-3English 0.951
Group-4Turkish 0.965
Academic literacy scaleGroup-1Mathematics0.8020.867
Group-2Special Education0.9010.875
Group-3English 0.901
Group-4Turkish 0.875

Source(s): Table by authors

Critical thinking tendency scale pretest – posttest mean scores

GroupsMean (X)
PretestPosttest
Group-1Mathematics190.734194.326
Group-2Special Education196.875208.525
Group-3English197.625
Group-4Turkish203.540

Source(s): Table by authors

Critical thinking tendency scale group-1 and group-2 pretest – posttest t-test results

GroupsTestnXSstp
Group-1Pretest49190.7318.716−1,5340.131
Posttest49194.3315.672
Group-2Pretest40196.8820.795−3,0840.004
Posttest40208.5320.248

Source(s): Table by authors

Critical thinking tendency scale posttest scores 2 × 2 ANOVA results

SourcedfMSFp
Pre-test124.9130.0640.801
Method13545.7219.0900.003
Pretest × method1601.2781.5410.216
Error146390.066

Source(s): Table by authors

Academic literacy scale pretest – posttest mean scores

GroupsMean (X)
PretestPretest
Group-1Mathematics87.34690.596
Group-2Special Education88.30091.500
Group-3English 92.360
Group-4Turkish 91.105

Source(s): Table by authors

Academic literacy scale group-1 and group-2 pretest – posttest t-test results

GroupsTestnXSstp
Group-1Pretest5287.3466.709−2,9140.005
Posttest5290.5967.463
Group-2Pretest4088.3009.148−2,6290.012
Posttest4091.5008.938

Source(s): Table by authors

Academic literacy scale posttest scores 2 × 2 ANOVA results

SourcedfMSFp
Pretest120.3320.2620.609
Method10.4620.0060.939
Pretest × Method137.6200.4860.487
Error15277.468

Source(s): Table by authors

ANCOVA analysis results for academic literacy scale group-1 and group-2 scores

SourcedfMSFp
Pretest11568.62131.8160.000
Method13.5540.0720.789
Error8949.302

Source(s): Table by authors

Academic literacy scale group-3 and group-4 posttest scores t-test results

GroupsnXSstp
Group-3English2592.3609.8690.5000.619
Group-4Turkish3891.1059.666

Source(s): Table by authors

References

Aksela, M. and Haatainen, O. (2018), “Project-based learning (PBL) in practice: active teachers' views of its' advantages and challenges”, International STEM in Education Conference.

Bassham, G., Irwin, W., Nardone, H. and Wallace, J.M. (2011), Critical Thinking: A Student's Introduction, 4th ed., The McGraw-Hill Companies, New York.

Castillo-Martínez, R., Glasserman-Morales, C.P. and Ramírez-Montoya, M.S. (2023), “Academic literacy among the university students in Mexico and Spain: a holistic perspective”, Frontiers in Psychology, Vol. 13, pp. 1-14, doi: 10.3389/fpsyg.2022.1055954.

Coaley, K. (2010), An Introduction to Psychological Assessment and Psychometrics, SAGE, CA.

Demir, S. (2006), “The effect of quantum learning model on the students' success at secondary education(an experimental study in Gaziantep), Doctoral Thesis, Gaziantep University.

Demir, S. and Deniz, H. (2020), “Developing an academic literacy scale: assessing validity and reliability”, Kastamonu Education Journal, Vol. 28 No. 3, pp. 1366-1379, doi: 10.24106/kefdergi.4008.

Doru, M.N. (2018), “Akademik okuryazarlık [Academic literacy]”, in Musa Öztürk) Sosyal Bilimlerde Etik Sorunlar [Ethical Issues in Social Sciences], (pp. 87-102). Ankara: Nobel.

Duch, B.J., Groh, S.E. and Allen, D.E. (2001), The Power of Problem-Based Learning, Stylus Publishing, Sterling, VA.

Heard, J., Scoular, C., Duckworth, D., Ramalingam, D. and Teo, I. (2020), “Critical thinking: definition and structure”, Technical Report, Australian Council for Educational Research.

Johnson, D.S. (2002), “Quantum learning: lidership for learning organizations”, Futurics; St. Paul, Vol. 26 Nos 3/4, pp. 89-92.

Joynes, C., Rossignoli, S. and Fenyiwa Amonoo-Kuofi, E. (2019), 21st Century Skills: Evidence of Issues in Definition, Demand and Delivery for Development Contexts, K4D Helpdesk Report, Institute of Development Studies, Brighton.

Kim, S., Raza, M. and Seidman, E. (2019), “Improving 21st-century teaching skills: the key to effective 21stcentury learners”, Research in Comparative and International Education, Vol. 14, pp. 1-19, doi: 10.1177/1745499919829214.

Klalare, L., Rydeman, I., Kneck, Å., Bos Sparén, E., Winnberg, E. and Bisholt, B. (2022), “Methods and strategies to promote academic literacies in health professions: a scoping review”, BMC Medical Education, Vol. 22 No. 418, pp. 1-10, doi: 10.1186/s12909-022-03288-9.

Kline, P. (1986), A Handbook of Test Construction, Routledge, NY.

Li, D. (2022), “A review of academic literacy research development: from 2002 to 2019”, Asian-Pacific Journal of Second and Foreign Language Education, Vol. 7 No. 5, pp. 1-22, doi: 10.1186/s40862-022-00130-z.

Murawski, L.M. (2014), “Critical thinking in the classroom…and beyond”, Journal of Learning in Higher Education, Vol. 10 No. 1, pp. 25-30.

Ökmen, B., Şahin, Ş. and Kılıç, A. (2023), “A model that can be applied in both distance and face-to-face education: problem based-quantum learning model”, Balıkesir University the Journal of Social Sciences Institute, Vol. 26 No. 50, pp. 579-600.

Partnership for 21st Century Skills (2010), 21st Century Knowledge and Skills in Educator Preparation, AACTE, Washington, DC.

Pinheiro, M., Dionísio, M.L. and Vasconcelos, R.M. (2016), “Academic literacy, a barrier to learning? The views of engineering students”, ICERI 2016 Conference, Seville.

Purba, D., Janah, M. and Arianto, F. (2020), “The impact of problem based learning model on critical thinking ability in vocational education”, International Journal of Education and Research, Vol. 8 No. 12, pp. 33-40.

Racheal, A.A. (2019), “5E learning cycle ınstructional model: a constructivist approach in teaching science to pupils with visual ımpairment”, International Journal of Academic Research in Education and Review, Vol. 6 No. 4, pp. 79-87.

Şahin, Ş. and Kılıç, A. (2023a), “Effectiveness of the project-based 6E learning model”, European Journal of Open, Distance and E-Learning, Vol. 25 No. 1, pp. 31-48, doi: 10.2478/eurodl-2023-0003.

Şahin, Ş. and Kılıç, A. (2023b), “The effect of the project-based 6E learning model on students' perceptions of democracy. Ases IV”, International Educational Sciences Conference, Giresun, pp. 38-45.

Şahin, Ş. and Kılıç, A. (2023c), “Concept networks on the effects of project-based 6E learning model on students' value perceptions”, 1st Positive Schools & Well-Being Congress, Cyprus.

Sam, C.K., Owusu, K.A. and Anthony-Krueger, C. (2018), “Effectiveness of 3E, 5E and conventional approaches of teaching on students' achievement in high school biology”, American Journal of Educational Research, Vol. 6 No. 1, pp. 76-82, doi: 10.12691/education-6-1-12.

Santos, J.M. (2017), “21st Century learning skills: a challenge in every classroom”, International Journal of Emerging Multidisciplinary Research, Vol. 1 No. 1, pp. 31-35, doi: 10.22662/ijemr.2017.1.1.031.

Seibert, S.A. (2021), “Problem-based learning: a strategy to foster generation Z's critical thinking and perseverance”, Teaching and Learning in Nursing, Vol. 16 No. 1, pp. 85-88, doi: 10.1016/j.teln.2020.09.002.

Semerci, N. (2016), “The development of critical thinking disposition scale (CTDH): study on the revision of validity and reliability”, Turkish Studies, Vol. 11 No. 9, pp. 725-740.

Şenşekerci, E. and Bilgin, A. (2008), “Critical thinking and its teaching”, Uludağ University Faculty of Arts and Sciences Journal of Social Sciences, Vol. 9 No. 14, pp. 15-43.

Snyder, L.G. and Snyder, M.J. (2008), “Teaching critical thinking and problem solving skills”, The Delta Pi Epsilon Journal, Vol. 2, pp. 90-99.

Solomon, R.L. (1949), “An extension of control group design”, Psychological Bulletin, Vol. 46 No. 2, pp. 137-150, doi: 10.1037/h0062958.

Sümbüloğlu, K. and Sümbüloğlu, V. (2007), Biyoistatistik, Hatiboğlu Basım ve Yayım, Ankara.

van Engelenburg, G. (1999), Statistical Analysis for the Solomon Four-Group Design, Research Report, Twente Univ., Faculty of Educational Science and Technology.

Wahyuni, S. (2014), “The implementation of project-based learning to direct students in writing a research proposal”, Language Circle Journal of Language and Literature, Vol. 8 No. 2, pp. 193-205.

Walton Braver, M.C. and Braver, S.L. (1988), “Statistical treatment of the solomon four-group design: a meta-analytic approach”, Psychological Bulletin, Vol. 104 No. 1, pp. 150-154, doi: 10.1037//0033-2909.104.1.150.

Watkins, M.W. (2021), A Step-by-step Guide to Exploratory Factor Analysis with R and Rstudio, Routledge, New York.

Weideman, A. and van Dyk, T. (2014), Academic Literacy: Test Your Competence, Geronimo Distribution (Pty), Bloemfontein.

Willingham, D.T. (2020), “Critical thinking: why is it so hard to teach”, American Educator, Vol. 31, pp. 8-19.

Zoller, U. (1991), “Problem solving and the “problem solving paradox” in decision-makingoriented environmental education”, in Keiny, S. and Zoller, U. (Eds), Conceptual Issues in Environmental Education, Peter Lang, New York, pp. 71-88.

Corresponding author

Şeyma Şahin can be contacted at: seyymasahin@gmail.com

Related articles