Search results
1 – 10 of 453The main purpose of this study was to examine the relationship between student ratings and teacher ratings on a university-level writing assignment in order to investigate the…
Abstract
The main purpose of this study was to examine the relationship between student ratings and teacher ratings on a university-level writing assignment in order to investigate the extent to which students have the ability and wherewithal to accurately and reliably assess themselves on a finished writing product. The Pearson Product Moment coefficient was used to determine whether or not there was a statistical correlation between student scores and teacher scores while the Intra-Class Coefficient and Spearman Brown Prophecy formula were used to determine the degree of agreement between raters as well as amongst all of the raters for an average reliability score. In this case the results were very promising as it was found that student and teacher scores correlated very highly and demonstrated a strong degree of agreement. This suggests that self assessment may be used to assist students in this particular context to better understand the conventions of English writing and ultimately improve their overall writing ability.
Dirk Ifenthaler and Muhittin ŞAHİN
This study aims to focus on providing a computerized classification testing (CCT) system that can easily be embedded as a self-assessment feature into the existing legacy…
Abstract
Purpose
This study aims to focus on providing a computerized classification testing (CCT) system that can easily be embedded as a self-assessment feature into the existing legacy environment of a higher education institution, empowering students with self-assessments to monitor their learning progress and following strict data protection regulations. The purpose of this study is to investigate the use of two different versions (without dashboard vs with dashboard) of the CCT system during the course of a semester; to examine changes in the intended use and perceived usefulness of two different versions (without dashboard vs with dashboard) of the CCT system; and to compare the self-reported confidence levels of two different versions (without dashboard vs with dashboard) of the CCT system.
Design/methodology/approach
A total of N = 194 students from a higher education institution in the area of economic and business education participated in the study. The participants were provided access to the CCT system as an opportunity to self-assess their domain knowledge in five areas throughout the semester. An algorithm was implemented to classify learners into master and nonmaster. A total of nine metrics were implemented for classifying the performance of learners. Instruments for collecting co-variates included the study interest questionnaire (Cronbach’s a = 0. 90), the achievement motivation inventory (Cronbach’s a = 0. 94), measures focusing on perceived usefulness and demographic data.
Findings
The findings indicate that the students used the CCT system intensively throughout the semester. Students in a cohort with a dashboard available interacted more with the CCT system than students in a cohort without a dashboard. Further, findings showed that students with a dashboard available reported significantly higher confidence levels in the CCT system than participants without a dashboard.
Originality/value
The design of digitally supported learning environments requires valid formative (self-)assessment data to better support the current needs of the learner. While the findings of the current study are limited concerning one study cohort and a limited number of self-assessment areas, the CCT system is being further developed for seamless integration of self-assessment and related feedback to further reveal unforeseen opportunities for future student cohorts.
Details
Keywords
Peter E. Johansson, Helena Blackbright, Tomas Backström, Jennie Schaeffer and Stefan Cedergren
The purpose of this paper is to increase the understanding regarding how managers attempt to make purposeful use of innovation management self-assessments (IMSA) and performance…
Abstract
Purpose
The purpose of this paper is to increase the understanding regarding how managers attempt to make purposeful use of innovation management self-assessments (IMSA) and performance information (PI).
Design/methodology/approach
An interpretative perspective on purposeful use is used as an analytical framework, and the paper is based on empirical material from two research projects exploring the use of IMSA and PI in three case companies. Based on the empirical data, consisting of interviews and observations of workshops and project meetings, qualitative content analysis has been conducted.
Findings
The findings of this paper indicate that how managers achieve a purposeful use of PI is related to their approach toward how to use the specific PI at hand, and two basic approaches are analytically separated: a rule-based approach and a reflective approach. Consequently, whether or not the right thing is being measured also becomes a question of how the PI is actually being interpreted and used. Thus, the extensive focus on what to measure and how to measure it becomes edgeless unless equal attention is given to how managers are able to use the PI to make knowledgeable decisions regarding what actions to take to achieve the desired changes.
Practical implications
Given the results, it comes with a managerial responsibility to make sure that all managers who are supposed to be engaged in using the PI are given roles in the self-assessments that are aligned with the level of knowledge they possess, or can access.
Originality/value
How managers purposefully use PI is a key to understand the potential impact of self-assessments.
Details
Keywords
Tiprawee Tongtummachat, Attasak Jaree and Nattee Akkarawatkhoosith
This article presents our experience in implementing the assessment for learning process (AfL) to enhance the teaching–learning quality, which has faced numerous challenges…
Abstract
Purpose
This article presents our experience in implementing the assessment for learning process (AfL) to enhance the teaching–learning quality, which has faced numerous challenges impacting educational quality. The effectiveness of this technique is demonstrated through a case study conducted in a core course of chemical engineering.
Design/methodology/approach
The article shares insights into the systematic course design and planning processes that were discussed and developed through AfL practices. Significant emphasis is placed on implementing formative and summative student self-assessment surveys as simple yet effective methods to meet this purpose. Quantitative data were collected and analyzed over three consecutive academic years (2020–2022) using various statistical parameters such as percentage, interquartile range and the program’s numerical goal (%G).
Findings
The AfL process via formative and summative surveys could significantly and effectively improve teaching–learning quality. These findings assist educators in identifying appropriate teaching methods and recognizing areas of weakness and strength, thereby facilitating continuous improvement in the teaching–learning quality. Validation methods, including quizzes and numerical grades, were employed to practically verify the outcome obtained from the questionnaires.
Practical implications
The AfL techniques demonstrated in this study can be directly implemented or adapted for various educational fields to enhance the teaching–learning quality.
Originality/value
The practical implementation of AfL in an engineering context has hardly been reported, particularly in chemical engineering. This work represents the practical implementation of AfL to enhance engineering field education.
Details
Keywords
Michał T. Tomczak, Paweł Ziemiański and Małgorzata Gawrycka
The study aims to examine the digital competence of young employees (under 30 years of age) who graduated from the technical university. Self-assessment of selected digital…
Abstract
Purpose
The study aims to examine the digital competence of young employees (under 30 years of age) who graduated from the technical university. Self-assessment of selected digital competencies was examined along with the determination of a self-efficacy level in the area of using digital competencies.
Design/methodology/approach
Quantitative research was conducted using the computer-assisted web interview method on a sample of 4532 respondents.
Findings
Young employees' self-assessment of digital competencies and self-efficacy in the area of using them is high, and it can be assumed that they perceive themselves as digitally competent. Both digital self-efficacy and assessed digital competencies have a positive impact on satisfaction with the university.
Research limitations/implications
The research sample consisted only of employees who graduated from the technical university, but the results may provide feedback on the demand for digital competencies sought in the labor market and constitute valuable information useful in university curriculum development and in vocational education and training.
Originality/value
This is the first study that focuses on the Kozanoglu and Abedin approach to the concept of digital literacy in the context of research on self-assessment and self-efficacy in using digital competencies among technical university graduates, adapting the creative self-efficacy scale by Tierney and Farmer, for measuring digital self-efficacy.
Highlights/value
Young employees' digital competencies self-assessment is high.
Young employees' self-efficacy of using digital competencies is high.
Graduating from a DT-focused department has a positive impact on satisfaction.
Digital self-efficacy has a positive impact on satisfaction with the university.
Assessed digital competencies have a positive impact on satisfaction.
Young employees' digital competencies self-assessment is high.
Young employees' self-efficacy of using digital competencies is high.
Graduating from a DT-focused department has a positive impact on satisfaction.
Digital self-efficacy has a positive impact on satisfaction with the university.
Assessed digital competencies have a positive impact on satisfaction.
Details
Keywords
Laura Saukko, Kirsi Aaltonen and Harri Haapasalo
The purpose of this paper is to define the integration capability dimensions and create a model for self-assessing the integration capability in inter-organizational projects.
Abstract
Purpose
The purpose of this paper is to define the integration capability dimensions and create a model for self-assessing the integration capability in inter-organizational projects.
Design/methodology/approach
A theoretical construct of, referred in this study as integration capability framework is elaborated following a systematic literature review. Thereafter, an integration capability self-assessment model, based on maturity thinking, is derived from the theoretical framework. The self-assessment model is further developed and tested for validity within five inter-organizational project networks in cooperation with industry practitioners, representing construction, industrial engineering, and mining sectors.
Findings
The results show that inter-organizational projects can use the developed model in self-assessing the maturity levels of various integration mechanisms, thus the state of integration capability at any point in time during inter-organizational projects.
Originality/value
This study is an attempt to identify how the integration capability dimensions can be self-assessed in inter-organizational projects, through the maturity levels of various integration mechanisms. The results offer insights for both academics and project management practitioners.
Details
Keywords
Zhiwei Zeng, Chunyan Miao, Cyril Leung and Zhiqi Shen
This paper aims to adapt and computerize the Trail Making Test (TMT) to support long-term self-assessment of cognitive abilities.
Abstract
Purpose
This paper aims to adapt and computerize the Trail Making Test (TMT) to support long-term self-assessment of cognitive abilities.
Design/methodology/approach
The authors propose a divide-and-combine (DAC) approach for generating different instances of TMT that can be used in repeated assessments with nearly no discernible practice effects. In the DAC approach, partial trails are generated separately in different layers and then combined to form a complete TMT trail.
Findings
The proposed approach was implemented in a computerized test application called iTMT. A pilot study was conducted to evaluate iTMT. The results show that the instances of TMT generated by the DAC approach had an adequate level of difficulty. iTMT also achieved a stronger construct validity, higher test–retest reliability and significantly reduced practice effects than existing computerized tests.
Originality/value
The preliminary results suggest that iTMT is suitable for long-term monitoring of cognitive abilities. By supporting self-assessment, iTMT also can help to crowdsource the assessment processes, which need to be administered by healthcare professionals conventionally, to the patients themselves.
Details
Keywords
Adrijana Visnjic Jevtic and Edita Rogulj
The aim of this research was to find out students' and mentors' attitudes toward the quality of mentoring support during teaching practicums. The research sought to determine…
Abstract
Purpose
The aim of this research was to find out students' and mentors' attitudes toward the quality of mentoring support during teaching practicums. The research sought to determine whether there is any difference in (self) assessment between teacher mentors and early childhood education students.
Design/methodology/approach
Through the quantitative research methodology, the Crisp (2009) College Student Mentoring Scale (CSMS) instrument was used to assess the quality of mentoring support during teaching practicums. Assessments were made in relation to the following variables: support in the areas of psychological and emotional needs, support in professional development and the development of professional competencies and the role of mentors as models. Early childhood education students (n1 = 105) and mentors (n2 = 54) of teaching practicums at the Faculty of Teacher Education, University of Zagreb, participated in the research.
Findings
The results of the research show that there is a statistically significant difference between student assessments and mentor self-assessment with regard to all researched areas of support. Mentors rated their mentoring skills higher than students did.
Originality/value
An approach in which mentoring is assessed in the context of support to students in different areas (e.g. psychological, emotional, professional) is rarely used in early childhood teacher education. Results indicate the need for a systematic evaluation of mentoring and the design of programs to strengthen mentoring competences.
Details
Keywords
Shannon Irene Nolan-Arañez and Marilee Bresciani Ludvik
Similar to religion, spirituality is considered a private affair along with issues of faith, hope, and love (Palmer, 1998). American public education has been reluctant to address…
Abstract
Purpose
Similar to religion, spirituality is considered a private affair along with issues of faith, hope, and love (Palmer, 1998). American public education has been reluctant to address such issues due to our cultural norm of “separation of church and state” (Love and Talbot, 2000, p. 1) yet the American Council for Education calls upon higher education to provide students ways to explore their personal values, world beliefs, and spirituality (Chickering et al., 2006; Dalton and Crosby, 2006). As such, the purpose of this paper is to explore student leaders’ perspectives on how leadership development activities influenced their sense of spirituality.
Design/methodology/approach
A qualitative case study design was used to explore responses from ten student leaders who completed a leadership development program in the Spring 2015 at a public four-year institution. As part of the leadership development program, students were paired a peer mentor while they completed leadership workshops, a reflection paper, self-assessment, and an ongoing community service project painting murals with individuals who have intellectual disabilities. Participants were from various majors and religious backgrounds and had completed the leadership development program two months prior to their participation in this study.
Findings
Findings revealed that leadership workshops, self-assessment, reflections, peer-to-peer mentorship, and an ongoing shared community service project, influenced students’ perspectives of spirituality and their leadership identity. Student leaders both did and did not differentiate the developmental process of leadership from the spiritual development process, defining both as cognitive and emotional development deeply grounded in self-awareness. Study participants shared that through self-reflection, developing their inter and intra personal skills through conducting service, shaped their understanding of their spiritual identity and developed their sense of self.
Research limitations/implications
Study results are not generalizable but provide insight into the experiences and perceptions of student leaders on two hard-to-define topics: spirituality and leadership. The order of the interview questions may have influenced the thought process leading up to student’s responses connecting spirituality and leadership concepts. Another limitation is that the leadership activities were designed and coordinated by the lead investigator. Hence, there may be findings that were influenced by the investigators’ personal beliefs about leadership. Study participants may have also felt more comfortable discussing their beliefs about spirituality because of their familiarity with the lead investigator.
Practical implications
Results support the notion that non-faith based public institutions may intentionally support the spiritual development of students through the context of leadership development program activities. Approaching spiritual and leadership development through Baxter Magolda’s (2009) theory of self-authorship allows students to experience new activities coupled with personal self-reflection, to deepen their self-understanding, compassion for others, and self-awareness. This learning is an ongoing process that expands as students engage in contemplative practices such as mindfulness training provided through leadership workshops, self-reflection, and peer-to-peer interactions and self-assessment.
Social implications
This case study illustrates that intentionally designed and implemented leadership development programs may cultivate both the spiritual and leadership identities and behaviors of students. Also, this study reveals that spirituality and leadership are not mutually exclusive processes because both are deeply rooted in connecting to our community, connecting to our greater purpose and our higher consciousness about who we are and how we treat others. Hence, this work may support educators develop more compassionate and empathetic students who are agents of positive social change.
Originality/value
This qualitative case study suggests a new framework for public institutions to support students’ leadership and spiritual development through the theoretical framework of self-authorship. As such, educators can stop being fearful about discussing religion, spirituality, and matters of the heart if they use this framework to design leadership developmental activities.
Details
Keywords
Sri Setiawaty, Nuraini Fatmi, Ayu Rahmi, Ratna Unaida, Fakhrah, Izkar Hadiya, Iryana Muhammad, Mursalin, Muliana, Rohantizani, Alchalil and Ratih Permana Sari
Purpose – The aim of this study is to determine the effects of inquiry instruction incorporating with STEM learning on Chemistry Education of Malikussaleh University students’…
Abstract
Purpose – The aim of this study is to determine the effects of inquiry instruction incorporating with STEM learning on Chemistry Education of Malikussaleh University students’ science process skills and science attitudes.
Design/Methodology/Approach – The pre-experimental design, which is a mixed method approach is used in the study that included a pretest-posttest one group model and descriptive quantitative.
Findings – As a result of data analysis that STEM learning significantly enhances students’ science process skills and attitudes toward inquiry instruction. This study examines how participation in a semester long inquiry-based STEM learning project that involves interdisciplinary skills, sociological research on attitudes, and behaviors enhances the scientific and quantitative literacies of STEM students.
Research Limitations/Implications – Quantitative research is needed to determine the more common effects of learning outcomes. However, this study only determines a self-assessment on science attitudes. The other one is a limitation on the participants and reviewing aspects of learning with more variables in order to obtain more optimal results.
Practical Implications – The results of this study have practical implications in terms of hands-on activities. The learning model can be used to explain the concept of multidisciplinary studies and particularly to students and their parents. It will be a useful model for lecturers, personal tutors, and any other practitioners involved in hands-on activities.
Originality/Value – This paper innovative at a conceptual level of education development for students, graduates, and it is very simple descriptive papers. It will be of value to anybody with an interest in education competitiveness issues.
Details