Search results

1 – 10 of over 4000
Article
Publication date: 18 December 2023

Kasun Gomis, Mandeep Saini, Mohammed Arif and Chaminda Pathirage

Lack of appropriate student support and drawbacks in academic progression signify the importance of enhancing assessment and feedback in higher education (HE). Although assessment…

Abstract

Purpose

Lack of appropriate student support and drawbacks in academic progression signify the importance of enhancing assessment and feedback in higher education (HE). Although assessment and feedback are significant in HE, minimal empirical research holistically explores the best practices. This study aims to address the niche and develop a decisive guideline for enhancing assessment setting and feedback provision within HE curricula.

Design/methodology/approach

A systematic approach was taken to obtain data for the study: a literature review underpinning the thematic content analysis of study documents, followed by semi-structured interviews. Document analysis contained mid-module reviews/student feedback; rubrics used in assessment; and formative/summative feedback provided for the graded work. Documental analysis informed the key attributes of the semi-structured interview. Interpretive structural modelling (ISM) analysis identified the influence and reliance of each driver.

Findings

This study revealed 15 drivers – 4 fundamental, 6 significant and 5 important – for enhancing assessment and feedback. The level partitioning from the ISM analysis established that all assessment and feedback needs to be underpinned by the university policy and fed into the assessment regime and marking scheme. This study identified that National Student Survey results were significantly improved due to implementing said drivers compared with the national and sector benchmarks.

Practical implications

The developed drivers enable the best practices in assessment setting and feedback provision. The level partition diagram can be used as a decisive guideline or a provisional framework in assessment and feedback provision for quality assurance in HE.

Originality/value

This study is one of, if not the only, to develop a guideline for signposting drivers and their influence and reliance to enhance assessment and feedback in a holistic HE setting. The developed drivers and the level partition diagram bring novelty and add to the current body of knowledge.

Article
Publication date: 25 January 2024

Kuan-Cheng Lin, Nien-Tzu Li and Mu-Yen Chen

As global issues such as climate change, economic growth, social equality and the wealth gap are widely discussed, education for sustainable development (ESD) allows every human…

Abstract

Purpose

As global issues such as climate change, economic growth, social equality and the wealth gap are widely discussed, education for sustainable development (ESD) allows every human being to acquire the knowledge, skills, attitudes and values necessary to shape a sustainable future. It also requires participatory teaching and learning methods that motivate and empower learners to change their behavior and take action for sustainable development. Teachers have begun rating pupils based on peer assessment for open evaluation. Peer assessment enables students to transition from passive to active feedback recipients. The assessors improve critical thinking and encourage introspection, resulting in more significant recommendations. However, the quality of peer assessment is variable, resulting in reviewers not recognizing the remarks of other reviewers, therefore the benefits of peer assessment cannot be fulfilled. In the past, researchers frequently employed post-event questionnaires to examine the effects of peer assessment on learning effectiveness, which did not accurately reflect the quality of peer assessment in real time.

Design/methodology/approach

This study employs a multi-label model and develops a self-feedback system in order to use the AIOLPA system in the classroom to enhance students' learning efficacy and the validity of peer assessment.

Findings

The research findings indicate that the better peer assessment through the rapid feedback system, for the evaluator, encourages more self-reflection and attempts to provide more ideas, so bringing the peer rating closer to the instructor rating and assisting the evaluator. Improve self-evaluation and critical thinking for the evaluator, peers make suggestions and comments to help improve the work and support the growth of students' learning effectiveness, which can lead to more suggestions and an increase in the work’s quality.

Originality/value

ESD consequently promotes competencies like critical thinking, imagining future scenarios and making decisions in a collaborative way. This study builds an online peer assessment system with a self-feedback mechanism capable of classifying peer comments, comparing them with scores in a consistent manner and providing prompt feedback to critics.

Details

Library Hi Tech, vol. ahead-of-print no. ahead-of-print
Type: Research Article
ISSN: 0737-8831

Keywords

Article
Publication date: 7 September 2023

Benjamin Ajibade and Catherine Hayes

The aim of the study is to explore perceptions of the impact of assessment feedback by international undergraduate nursing students. Research to date indicates that summative…

Abstract

Purpose

The aim of the study is to explore perceptions of the impact of assessment feedback by international undergraduate nursing students. Research to date indicates that summative assessment feedback may impact significantly on student achievement but if it is undertaken sub optimally or does not provide students with the opportunity to engage with the process and reflexively respond, it can also be exceptionally damaging to the learning experience.

Design/methodology/approach

A scoping exercise of overall student feedback experience was initially collated via the adoption of an Interpretive Phenomenological Approach (IPA). Participants were recruited via purposive sampling and the LEGO® Serious Play® method was used to collect data. Analysis with Quirkos software was used to examine the salience as well as commonality of findings as an integral part of a recognised five-step thematic analytical approach.

Findings

Feedback was perceived, by students, as significantly impacting factor in relation to their overall progression, attainment and retention rates. Themes generated from the findings evidenced student perceptions that summative feedback is a positive driver and source of motivation for academic success and progression. It was perceived that levels of attainment were related to the clarity, quality and individualised nature of feedback that students received and that this was perceived to be evident in their final grades. These were accompanied by perceptions that feedback clarity also determined the potential of breaking down perceived student barriers to learning, their perceived capacity for effective assignment planning and preparation and the likelihood of them having any positive collective or individual interpersonal relationships with their tutors. Summarised, students perceived that feedback ought to lead to student empowerment in managing their studies and as such it ought to be clear, straightforward and non-ambiguous.

Research limitations/implications

The methodological design of the study means that generalisability from its findings was never intended or possible. However, there may be the potential transferability of findings to similar institutions and contexts of nurse education with students who have similar demographic profiling. The study was also a means of providing an insight into the lived experience of students which could be used in the prospective adaptation of feedback mechanisms for staff at a local level within Higher Education.

Practical implications

The study reveals the perceived impact of gamification as a mechanism of summative assessment as conveyed by a designated group of students. Whilst specific recommendations for change can only be made within the context specificity of the research, there may be aspects of the findings which are potentially transferable to other similar contexts of Higher Education delivery whose pedagogical approaches mirror those in operation at the institution where the research was undertaken. It became apparent that the standardisation of feedback approaches offered many opportunities to improve existing systems. The issue of monitoring workloads is also of significance in terms of the level and degree of summative assessment and feedback that academic staff can undertake.

Originality/value

The study revealed the perceived magnitude of assessment feedback on progression, attainment and retention rates, alongside the perceived need for a universal feedback template and the opportunity to provide audio-video feedback. This study adds to existing knowledge in the field of pedagogic practice about both the execution of LEGO® Serious Play® as a research methodology and why the perceptions of feedback as articulated and illuminated by a group of contemporary nursing students ought to matter in the context of Higher Education.

Details

Higher Education, Skills and Work-Based Learning, vol. 14 no. 2
Type: Research Article
ISSN: 2042-3896

Keywords

Open Access
Article
Publication date: 27 November 2023

Thomas Howard Morris, Michael Schön and Michael Charles Drayson

There has been an unprecedented increase in online learning worldwide, including in teacher education. However, student lurking can be a common issue, leading to a non-interactive…

Abstract

Purpose

There has been an unprecedented increase in online learning worldwide, including in teacher education. However, student lurking can be a common issue, leading to a non-interactive learning environment.

Design/methodology/approach

The authors employed a qualitative case study with thematic analysis to examine a novel “self-directed” pre-service teacher online degree module that engaged students in regular peer-feedback, which intended to promote student engagement and interactivity. The research questions were as follows: To what extent did the seminar series represent the principles of self-directed learning and were learning outcomes effective from the process? And, how effective was the use of peer feedback?

Findings

The thematic analysis revealed that student progression and course completion was successful, and it represented some principles of self-directed learning; but (a) it cannot be presumed that pre-service teachers are competent in giving (peer) feedback and (b) pre-service teachers may need specific guidance and training for providing competent feedback.

Originality/value

This paper is highly original in respect of its combination of the self-directed learning framework with use of peer feedback, to engage students in an interactive learning environment. The present paper identifies that peer feedback is a powerful tool in online learning; peer feedback can supplement self- and teacher-assessment; but it should not be assumed that pre-service teachers are competent in providing (peer) feedback – pre-service teachers may need specific training in providing feedback.

Details

Journal of Research in Innovative Teaching & Learning, vol. ahead-of-print no. ahead-of-print
Type: Research Article
ISSN: 2397-7604

Keywords

Open Access
Article
Publication date: 6 February 2024

Tiprawee Tongtummachat, Attasak Jaree and Nattee Akkarawatkhoosith

This article presents our experience in implementing the assessment for learning process (AfL) to enhance the teaching–learning quality, which has faced numerous challenges…

Abstract

Purpose

This article presents our experience in implementing the assessment for learning process (AfL) to enhance the teaching–learning quality, which has faced numerous challenges impacting educational quality. The effectiveness of this technique is demonstrated through a case study conducted in a core course of chemical engineering.

Design/methodology/approach

The article shares insights into the systematic course design and planning processes that were discussed and developed through AfL practices. Significant emphasis is placed on implementing formative and summative student self-assessment surveys as simple yet effective methods to meet this purpose. Quantitative data were collected and analyzed over three consecutive academic years (2020–2022) using various statistical parameters such as percentage, interquartile range and the program’s numerical goal (%G).

Findings

The AfL process via formative and summative surveys could significantly and effectively improve teaching–learning quality. These findings assist educators in identifying appropriate teaching methods and recognizing areas of weakness and strength, thereby facilitating continuous improvement in the teaching–learning quality. Validation methods, including quizzes and numerical grades, were employed to practically verify the outcome obtained from the questionnaires.

Practical implications

The AfL techniques demonstrated in this study can be directly implemented or adapted for various educational fields to enhance the teaching–learning quality.

Originality/value

The practical implementation of AfL in an engineering context has hardly been reported, particularly in chemical engineering. This work represents the practical implementation of AfL to enhance engineering field education.

Details

Journal of Research in Innovative Teaching & Learning, vol. ahead-of-print no. ahead-of-print
Type: Research Article
ISSN: 2397-7604

Keywords

Article
Publication date: 17 January 2024

Belén Pagone, Paula Cecilia Primogerio and Sol Dias Lourenco

The purpose of this paper is to describe this new evaluation experience with portfolio in economics, not only from the teacher’s point of view but from the student perspective…

Abstract

Purpose

The purpose of this paper is to describe this new evaluation experience with portfolio in economics, not only from the teacher’s point of view but from the student perspective, and all the learning from its implementation; to provide ideas of evaluation practices in virtual and face-to-face modality in international business education; to motivate the rethinking of assessment practices in higher education to combine the best of each modality in the future.

Design/methodology/approach

The present work is a case study based on a qualitative description of the implementation of a portfolio as an assessment practice, supported by a reflection questionnaire with students’ perceptions and some elements of metacognition. The first section summarizes the literature used as a theoretical framework of this work. The second section describes the portfolio implementation by analyzing teachers and students reflections with a qualitative approach. The third section presents the findings. The fourth section is a discussion of findings, practical implications, limitations and future research directions. Finally, the conclusions of the work are shared.

Findings

Because the portfolio has had overwhelming results to assess what students have learned during the pandemic, it has become the learning and assessment tool after the pandemic, as it transforms the classes experience by shifting the focus from traditional examinations to more comprehensive, personalized and reflective ones. It also empowers students to take ownership of their learning, develop essential skills and cultivate a deeper understanding. Among other benefits, the portfolio means the creation of a safe and supportive environment for honest reflection, the development and design of strategic directions to improve learning and lead students toward metacognitive autonomy. Reflection pieces, a critical component of the portfolio, are a vital tool in the proactive learning process, as through reflection students learn to examine their own performance and discuss strategies to enhance their success in future work.

Research limitations/implications

This work began as an educational experience per se, not for research purposes, which caused it to be systematized and reconstructed in a descriptive way, not to measure quantitative results. In this way, the present work describes that the portfolio helps to achieve better results on students’ learning than traditional examinations but, as another limitation, it does not measure them nor the process. One more limitation of this work is that it was written in a postpandemic context but was implemented during the pandemic; therefore, the circumstances of writing are not the same as those of implementation, and this could also entail a certain margin of decontextualization. At the same time, this is an experience that is still in process and continually being adapted to this changed and changing educational postpandemic context.

Practical implications

One of the main implications of the portfolio experience, transferable to all educational contexts, is that it transforms the final exam into a metacognitive one, letting students be aware of their own process of learning and results – objectives and competences – acquired. In this way, it lets teachers witness a part of the learning process that is not so evident in the traditional assessment practices – focused on some aspect of the learning – as it makes visible the way in which students receive, process and apply content, that is to say, how they make it their own.

Social implications

The portfolio promotes reflective learning and metacognition, vital skills that benefit students beyond the classroom. This can have a positive impact on societal attitudes toward education and the quality of learning. Of the students, 82% felt the portfolio creation was helpful in their personal and professional lives, suggesting a broader societal impact. The paper’s findings contribute to the body of knowledge about the effectiveness of portfolio-based assessment in higher education, especially in the worldwide transition from online education to postpandemic education. This could guide future studies in similar educational contexts or with different pedagogical innovative tools.

Originality/value

In light of the 2020 pandemic lockdown, this work delves into the pressing need for educators to adapt and modify their teaching approaches. The relevance of this study is accentuated by the worldwide transition from online education to postpandemic education. This paper bridges the gap between theory and practice because the research can be applied to the educational practice of any international business education context, as well as lay the foundations for future research in the field that contributes to increasing evidence of the effectiveness of the use of the portfolio to achieve significant and deep learning in higher education.

Details

Journal of International Education in Business, vol. ahead-of-print no. ahead-of-print
Type: Research Article
ISSN: 2046-469X

Keywords

Article
Publication date: 16 January 2023

Joseph S. Nadan, Abram Walton, Behzad Tabaei, Charles Edward Bryant and Natalie Shah

This paper aims to propose an innovative method for deploying a personalized instructor-created software-aided assessment system, that will disrupt traditional learning…

Abstract

Purpose

This paper aims to propose an innovative method for deploying a personalized instructor-created software-aided assessment system, that will disrupt traditional learning environments by allowing students to confidentially and with indirect supervision from the instructor, assess their knowledge and ability to achieve the course outcomes.

Design/methodology/approach

Through empirical evaluation in real-world educational settings, the authors examine the impact of augmenting human activity in the classroom with an innovative software platform to transform the learning process.

Findings

Findings indicate that this software-aided assessment system effectively augments human interactivity by providing timely instructor-designed feedback to increase knowledge retention and skillsets.

Practical implications

This study has shown that incorporating disruptive innovation through the use of software-aided assessment systems increases the effectiveness of the faculty in the classroom and enhances student learning and retention. Thus, a transformative software-aided assessment system design that incorporates artificial intelligence into the learning pathway should be pursued. These software-aided assessments are disruptive innovation as they are formative, frequent and require little direct involvement from the instructor.

Originality/value

To the best of the authors’ knowledge, this study is the first of its kind to incorporate artificial intelligence into the assessment process by analyzing results of pilot programs at several universities. The results demonstrate how using software-aided transformative assessments in various courses have helped instructors assess students’ preparedness and track their learning progress. These software-aided systems are the first step in bringing disruptive innovation to the classroom as these software-aided assessment instruments rapidly assess learners’ knowledge and skills based on short, easily created, multiple-choice tests, with little direct engagement from the faculty.

Article
Publication date: 4 April 2024

Jill Flint-Taylor and Alexander Davda

The study’s aim was to design and test a leadership development approach using blended learning, to equip leaders for strengthening their own resilience and that of their teams.

Abstract

Purpose

The study’s aim was to design and test a leadership development approach using blended learning, to equip leaders for strengthening their own resilience and that of their teams.

Design/methodology/approach

A contextualised leadership development intervention was produced and evaluated following the principles of design-based research. Participants were from three organisations that work internationally to address the impact of economic disadvantage. Initial research used the behavioural event interview technique. Online assessment incorporated measures of situational judgement, emotion recognition and attributional style. Validity measures were multi-rater feedback (criterion), and NEO-PI 3 (construct). Individual feedback and a simulation-based peer workshop were followed by a four-to-six month period of experience-driven development and a final peer workshop for consolidating and evaluating learning outcomes.

Findings

The online assessment was a valid measure of leaders’ personal resilience resources and their resilience-building capability. Overall, the intervention improved participants’ understanding of, and engagement with, the processes of strengthening individual and collective (team) resilience.

Research limitations/implications

The target sample size for the study was relatively small, to ensure it would be practical to replicate the approach when designing similar interventions for a senior leadership population in other contexts. Significant results provided robust evidence for the validity of the assessment approach. Findings for the workshops and experience-driven development phase were more tentative, but the value of the design iterations was clearly demonstrated.

Practical implications

The leadership development approach is suitable for application in other organisations, if similar principles are followed to produce and evaluate materials relevant to each broad sector context. Roll-out is cost-effective, with relatively few hours of blended or virtual delivery supporting experience-driven learning.

Social implications

The impact leaders have on the wellbeing of those who report to them is well established, but less has been done to develop and formally evaluate practical, cost-effective interventions to improve this impact. The approach validated in this study can be applied more widely to benefit employee wellbeing as well as performance.

Originality/value

The study developed and evaluated a new approach to preparing leaders for the challenge of building team resilience, an aspect of leadership capability that has been given relatively little attention to date.

Details

Journal of Management Development, vol. ahead-of-print no. ahead-of-print
Type: Research Article
ISSN: 0262-1711

Keywords

Article
Publication date: 4 March 2024

Da Yan

The study investigated the feedback seeking abilities of learners in L2 writing classrooms using ChatGPT as an automated written corrective feedback (AWCF) provider. Specifically…

Abstract

Purpose

The study investigated the feedback seeking abilities of learners in L2 writing classrooms using ChatGPT as an automated written corrective feedback (AWCF) provider. Specifically, the research embarked on the exploration of L2 writers’ feedback seeking abilities in interacting with ChatGPT for feedback and their perceptions thereof in the new learning environment.

Design/methodology/approach

Three EFL learners of distinct language proficiencies and technological competences were recruited to participate in the mixed method multiple case study. The researcher used observation and in-depth interview to collect the ChatGPT prompts written by the participants and their reflections of feedback seeking in the project.

Findings

The study revealed that: (1) students with different academic profiles display varied abilities to utilize the feedback seeking strategies; (2) the significance of feedback seeking agency was agreed upon and (3) the promoting factors for the development of students’ feedback seeking abilities are the proactivity of involvement and the command of metacognitive regulatory skills.

Research limitations/implications

Additionally, a conceptual model of feedback seeking in an AI-mediated learning environment was postulated. The research has its conceptual and practical implications for researchers and educators expecting to incorporate ChatGPT in teaching and learning. The research unveiled the significance and potential of using state-of-the-art technologies in education. However, since we are still in an early phase applying such tools in authentic pedagogical environments, many instructional redevelopment and rearrangement should be considered and implemented.

Originality/value

The work is a pioneering effort to explore learners' feedback seeking abilities in a ChatGPT-enhanced learning environment. It pointed out new directions for process-, and student-oriented research in the era of changes.

Details

Kybernetes, vol. ahead-of-print no. ahead-of-print
Type: Research Article
ISSN: 0368-492X

Keywords

Open Access
Article
Publication date: 22 February 2024

Daniele Morselli

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which…

Abstract

Purpose

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.

Design/methodology/approach

This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.

Findings

Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.

Research limitations/implications

One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.

Practical implications

At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.

Originality/value

So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.

Details

Education + Training, vol. 66 no. 10
Type: Research Article
ISSN: 0040-0912

Keywords

1 – 10 of over 4000