Search results

This study’s purpose is to contribute to literature on training evaluation following Kirkpatrick’s four-levels model and estimating each training program’s return on investment (ROI) using evidence from a small firm.

This case study uses data collected at a logistics company based upon training output indicators like training program evaluation data; individual performance evaluation reports; information on attained objectives; service and productivity levels; quality audit reports; and accounting data.

Results show that all the training programs addressed report evaluation procedures at the four different levels (reactions, learning, behavior and results). ROI for each training program was estimated based upon costs and benefits associated to each program. The two training programs presenting above-average returns address work quality and conditions. The program addressing corporate social responsibility issues produced below-average results.

Limitations to this study may result from collecting data in a single moment in time and using data from a single organization, excluding generalization and extrapolation of results.

This case study should inspire managers in small and medium enterprises (SME) to implement training evaluation practices and ROI estimation. Having the ROI estimation available allows better management of the training budget, as ROI’s presentation is an argument to assign value and progress.

The originality of this study regards the way it reports training evaluation practices at the four levels established by Kirkpatrick’s framework (2005) and complements it with ROI estimation regarding five training courses run at a Portuguese SME logistics firm.

A number of studies on Kirkpatrick’s four-level training evaluation model have been published, since its inception in 1959, either investigating it or applying it to evaluate the training process. The purpose of this bibliometric analysis is to reconsider the model, its utility and its effectiveness in meeting the need to evaluate training activities and to explain why the model is still worth using even though other later models are available.

This study adopts a “5Ws+1H” model (why, when, who, where, what and how); however, “when” and “how” are merged in the methodology. A total of 416 articles related to Kirkpatrick’s model published between 1959 and July 2020 were retrieved using Scopus.

The Kirkpatrick model continues to be useful, appropriate and applicable in a variety of contexts. It is adaptable to many training environments and achieves high performance in evaluating training. The overview of publications on the Kirkpatrick model shows that research using the model is an active and growing area. The model is used primarily in the evaluation of medical training, followed by computer science, business and social sciences.

This paper presents a comprehensive bibliometric analysis to reconsider the model, its utility, its effectiveness in meeting the need to evaluate training activities, its importance in the field measured by the growth in studies on the model and its applications in various settings and contexts.

The purpose of this paper was to undertake a comprehensive review of Kirkpatrick’s four-level evaluation model. Included was a brief discussion on the additions that have been suggested by critics attempting to make it more responsive to training practitioners’ needs as well as researchers’ inquiries. Also included is a contrast of Kirkpatrick’s model with the expanded model offered by Holton (1996) and a discussion of several key areas of agreement with his model as well as areas of concerns with Holton’s criticism of Kirkpatrick’s four-level model. This article also discussed the relationship of two key factors, not widely examined in the transfer of training literature that could impact the transfer of training to the workplace, namely trainee attributes and the supervisory role in training transfer as affected specifically by a manager’s degree of transformational leadership. A model depicting the balance between these two factors on training transfer was presented in an attempt to assist training professionals seeking to further understand the effects of this interaction on training transfer. Several recommendations were suggested to help training practitioners. Finally several recommendations were given for future studies.

This study aims to explain the evaluation of a training programme for older adults to make them facilitators of a memory training project. Older adults were trained as facilitators to respond to the need to continue training memory and promote the active role of adults in the community.

The Kirkpatrick model was used to comprehensively evaluate the training programme. The participants were 89 older adults from the city of Barcelona, with an average age of 73.1 years old. To evaluate the training programme, six instruments were administered, adapted to the four levels established in Kirkpatrick’s model.

The results obtained show that the programme to train facilitators enables older adults to become facilitators in a memory training project.

Two limitations have been identified. The first is to analyse the extent to which the participants learned from the facilitator’s memory training project. The second is the methodological improvement for future research on two issues: strengthening the validity of the instruments and incorporating a control group.

The implications for practice, presented in this article, are twofold. One is the importance of lifelong learning as a resource for remaining healthy. Another implication is the active role of older adults in the community.

This research enables older adults to become involved in responding to their own needs such as memory training. In turn, it contributes to promoting active ageing and community participation.

The research aims to discuss technical and vocational students' long-term and complete evaluation of learning effectiveness under school-wide thematic teaching design.

This study adopted a mixed qualitative and quantitative approach to measure the learning effectiveness of thematic teaching in technical vocational schools using the Kirkpatrick model. Qualitative research conducted in-depth interviews with 32 interviewees, including students, parents, teachers, graduate alumni and the supervisors of off-campus internship units. Quantitative research conducted a questionnaire survey on vocational students. A total of 221 valid questionnaires were collected. In addition, this research conducts another quantitative survey on cooperative enterprises to compare the actual effect of the implementation of the school-wide thematic teaching students with the others, and a total of 35 valid questionnaires were collected.

The results of the research found that the effectiveness of thematic teaching method can achieve the expected goals of each level of Kirkpatrick model. The students taking thematic teaching are significantly better and fitting in the industry expects. Therefore, this research suggests the comprehensive introduction of school-wide thematic teaching to other school operators.

This research is the first study used the Kirkpatrick model to evaluate the effectiveness of school-wide thematic teaching design in hospitality education and providing a practical case for schools. This research combined qualitative and quantitative research methods to investigate the effectiveness of the teaching method through multiple perspectives. Through the feedback from supervisors of the hospitality industry, the school-wide thematic teaching design provides a good foundation for technical and vocational graduates.

The purpose of this paper is to explore the evaluation of cabin crew food safety training using the Kirkpatrick model.

Using a snowballing technique, 26 cabin crew, managers, supervisors and trainers participated in in-depth, semi-structured interviews. Summative content analysis was used to evaluate the data.

In total, 26 respondents from 20 international airlines participated in the study. All respondents agreed that evaluating cabin crew food safety/hygiene issues is important in relation to in-flight food handling; for example, “Training evaluation helps in the improvement of the future training”; “We have an end of course feedback form, either done electronically or on paper and that looks at how the delegates felt the training went, if they came away learning something new, if the environment for learning was right, all sorts of things; the questionnaire is quite comprehensive”; and “Every trainee is given a feedback form to complete”. However, significant failures in food safety training and its evaluation were identified.

The evaluation of cabin crew food safety training shows that it is ineffective in some aspects, including learning achieved and behavioural change, and these can directly impact on the implementation of food safety practices. Evaluation failures may be due to the lack of available time in relation to other cabin crew roles. Further research may consider using a larger sample size, evaluating training effectiveness using social cognition models and assessments of airline and cabin crew food safety culture.

This is the first study that evaluates cabin crew food safety training using the Kirkpatrick model. The findings provide an understanding of the current evaluation of cabin crew food safety training and can be used by airlines for improving and developing effective future food safety training programmes. This, in turn, may reduce the risk of passenger and crew foodborne disease.

The purpose of this paper is to report the research findings of an evaluation of the impact of continuing education programs (CEPs) on library information science (LIS) professionals of academic libraries in Mumbai, India. The paper also introduces Donald Kirkpatrick model of training evaluation for Library Science research in the area of program evaluation.

The impact of CEPs was evaluated using Donald Kirkpatrick model of training evaluation using survey method. The impact was evaluated at four levels; reaction, learning, behavior and results. The population of the present study included 344 LIS professionals working at colleges libraries affiliated to University of Mumbai and Shreemati Nathibai Damodar Thackersey (SNDT) Women’s University in Mumbai, India. The data collected through questionnaire were supplemented by five specimen interviews of heads of institutions of the academic librarians who had attended more than five CEPs in five years, 2009-2013.

The findings of the study revealed that professionals were satisfied with CEP attendance; keen on gaining more knowledge and transferring the acquired knowledge and skills at their workplaces and interested in implementing the learning to achieve results. The reasons given by academic librarians on not implementing the learning in the library indicated that there were hindrances like lack of management support, lack of technical expertise, inadequate staff in the library, poor IT Infrastructure, etc. in transferring the learning at work.

The study was based on self-perceptions of respondents. The limitation of self-perception was eliminated to some extent by supplementing qualitative data wherever required. CEPs included conferences, seminars, workshops, refresher courses, orientation programs and online courses. Pre-test and post-test recommended by the Kirkpatrick model could not be conducted as the researcher has not adopted experimental design. The data of feedback from the organizers and content of the CEPs attended by respondents were not analyzed in the study.

The paper describes the implementation of Kirkpatrick model to evaluate the CEPs, which can be used by the organizers or institutions to evaluate the impact of CEPs in future. This will help them to improve upon the contents of CEPs making them more relevant and effective.

Evaluation of CEPs will be useful to ensure the effectiveness of CEPs and performance of LIS professionals.

This paper reports an original research initiative undertaken to evaluate the impact of CEPs attended by LIS professionals of Indian academic libraries in Mumbai, India. It fills the gap in LIS research. The application of Donald Kirkpatrick model of Training evaluation is also valuable for LIS research.

Due to technology advancement or transparency in system, there is a constant inflow and outflow of technology in the business for transparency and efficiency. To seize a competitive advantage, companies have emerged new technological solutions to respond to the change in the organization environment. There is a surge in the requirement of learning opportunities and effective training programs in the organization. The current study has been an effort to understand the potential of blockchain technology that can create better training evaluation.

The electronic-Delphi (e-Delphi) method has been conducted by recording the final consensus and to find a balance for implementation of blockchain technology and measuring training effectiveness. The current research is one of its new types where blockchain-enabled training effectiveness measurement (BETEM) model has been formulated using a qualitative approach.

The study has considered human resource (HR) professionals as the experts and based on their responses, the formulation of theoretical network model has been structured using e-Delphi–BETEM (e-DLH–BETEM) approach. By critically examining the experts’ responses and comments, the study formulated the four major themes and 11 subthemes for the smooth functioning of the BETEM for an organization.

The research aims to aid innovations in BETEMs model for training evaluation. The model will contribute incrementally toward the complete transformation of the training development programs of employees. The goal of BETEMs is to ensure that organizations, specifically HR personals can prepare themselves to have competitive advantage by using blockchain technology.

The application of blockchain technology in measuring the training effectiveness is an addition to existing literature as majority of existing studies have studied the use of technology for measuring training effectiveness.

This study evaluated the impact of a faculty training program on student assessment using the Kirkpatrick model.

A self-reported survey assessed 111 Saudi and non-Saudi participants' satisfaction. Subjective and objective measures (self-reported measures, assessment literacy inventory and performance-based assessment tasks) gauged participants' learning level. Pre- and post-training data were collected from 2020 to 2022.

A highly significant effect on satisfaction (>80%) and learning levels was observed, as manifested by workplace practices of student assessment (>70%, the cut-off score). Pre- and post-training comparisons of participants' satisfaction and assessment literacy scores showed significant improvements following training. Multiple regression analyses showed no significant effects for gender and educational attainment but a substantial impact of academic cluster on participants' student assessment skills.

Long-term effects of training faculty on assessment practices and student achievement will be studied at the institutional level in future research.

The current study contributes to human capital investment via faculty training on student assessment, helping them comply with assessment best practices. This assures the quality, fairness and consistency of assessment processes across disciplines in higher education institutions, enhances assessment validity and trust in educational services and may support institutional accreditation.

This study provides opportunities for sharing best practices and helps establish a community of practice. It enhances learning outcomes achievement and empowers higher education graduates with attributes necessary to succeed in the labor market. The human capital investment may have a long-term impact on overall higher education quality.

This study contributes to the scarce literature investigating the impact of training faculty from different clusters on student assessment using subjective and objective measures. It provides developing and evaluating a long-term student assessment program following the Kirkpatrick model.

Rooting in the literature on training and laying on Kirkpatrick model, this paper aims to explore key drivers of corporate training to identify how they can be combined into an integrated framework of learning for human capital development.

By adopting the constructivist grounded theory, this contribution analyzes the experience carried out in the last ten years by Virvelle, an Italian corporate training firm.

Results show the rise of five core categories, g1iving rise to an integrated model of Kirkpatrick. Their dynamic interplay led to a new orientation of Kirkpatrick model giving rise to a metalearning ecosystem.

Managerial implications have identified key factors on which building and implementing appropriate corporate training programmes capable of triggering co-generative processes of value creation. Particularly, the essential role of learning quality culture, digital technology and personalization are detected in integrating not only hard but furthermore soft shades of learning. Concerning theoretical implications, the emergence of key structural and systems enabling dimensions for learning, and contextual mechanisms involved in reshaping training effectiveness and achieving integrated learning outcomes are detected. The main limitation of this study lies in the need to generalize results: the conceptualized framework needs to be empirically tested.

The value of this research is built along three main points. The first is the integration among the core categories that an integrated learning system can be built on, promoting learning quality culture through positive feedback loops. The second is represented by the chance to enhance an integrated mutual knowledge development among engaged actors, thereby shaping a more holistic and multidimensional learning model. The third is related to the transversal role that digital technology plays in all phases of the training process as it integrates and enriches them.