Search results
1 – 10 of over 98000Changes in the format of library materials, increased amounts of information, and the speed at which information is being produced have created an unrelenting need for training…
Abstract
Changes in the format of library materials, increased amounts of information, and the speed at which information is being produced have created an unrelenting need for training for library staff members. Additionally, library employees are retiring in greater numbers and their accompanying expertise is being lost. The purpose of this study was to document evaluation practices currently used in library training and continuing education programs for library employees, including metrics used in calculating return-on-investment (ROI). This research project asked 272 library training professionals to identify how they evaluate training, what kind of training evaluation practices are in place, how they select programs to evaluate for ROI, and what criteria are important in determining an effective method for calculating ROI.
Dmitry Kucherov and Daria Manokhina
This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of…
Abstract
Purpose
This study aims to examine the features of training evaluation process in Russian manufacturing companies. On the basis of three assumptions regarding the differences in group of employees involved in training, duration and costs of a training program, the authors tried to find out the peculiarities of training evaluation tools and levels in Russian manufacturing companies.
Design/methodology/approach
The HR professionals from 24 Russian manufacturing companies completed the author’s online questionnaire.
Findings
The results revealed that the respondents perceived training evaluation as highly important, but their satisfaction level toward existing evaluation was low. The most significant training evaluation goal was recognized as raising the efficiency of training process and the most widely used training evaluation model was Kirkpatrick’s, with focus on the reaction level. It was confirmed that training evaluation tools used in Russian manufacturing enterprises differed among the employee groups and different levels of training evaluation depended on duration and cost of the training program.
Originality/value
This is the first study which focuses on current training evaluation processes and gaps in Russian manufacturing companies. The recommendations proposed by the authors could be used by an HR team to improve training evaluation depending on employee group involved in training, duration and costs of the training program.
Details
Keywords
The purpose of this paper is to propose an evaluation of training for shop assistants, specifically in retail chains.
Abstract
Purpose
The purpose of this paper is to propose an evaluation of training for shop assistants, specifically in retail chains.
Design/methodology/approach
The proposed evaluation is based on Kirkpatrick’s model and Phillips’ modification. The representative case study includes the application of the training evaluation at the fourth and fifth levels of evaluation in a particular chain of retail stores. The data were collected from the retail chain’s financial reports, internal documents related to training of employees and interviews with managers in the retail chain.
Findings
The results contribute to the training evaluation literature by presenting a training evaluation for shop assistant using evidence from a retail chain. The training focussed on selling skills and product knowledge; the details of evaluating the training are presented, encompassing mainly the benefits and costs of the training and return on investment calculation.
Research limitations/implications
The training evaluation was tested only in selected types of training courses for shop assistants. To generalise the results, its adoption in different types of training and retail companies is required in future research.
Practical implications
The application of this training evaluation should help to achieve training objectives and enhance the quality of training in the retail chain. The results of the paper can be used as practical inspiration for managers of retail stores.
Originality/value
This paper proposes and applies a specific evaluation of training courses in retail.
Details
Keywords
Training is a key strategy for human resources development and in achieving organisational objectives. Organisations and public authorities invest large amounts of resources in…
Abstract
Purpose
Training is a key strategy for human resources development and in achieving organisational objectives. Organisations and public authorities invest large amounts of resources in training, but rarely have the data to show the results of that investment. Only a few organisations evaluate training in depth due to the difficulty involved and the lack of valid instruments and viable models. The purpose of this paper is to present an evaluation model that has been successfully applied in the Spanish context that integrates all training dimensions and effects, to act as a global tool for organisations. The model analyses satisfaction, learning, pedagogical aspects, transfer, impact and profitability of training, and is therefore a global model.
Design/methodology/approach
The paper's approach is theoretical, and the methodology used involves a review of previous evaluation models and their improvement by comparing their application in practice.
Findings
An analysis of pedagogical aspects enables training professionals to improve training quality, as they are able to identify any weaknesses in elements, such as training design, needs analysis and training implementation, and improve on them. In fact, the quality of these elements depends entirely on the training professional. The improvement of pedagogical aspects, as a result of their evaluation, increases training quality and the results of training in organisations that can be identified by evaluating the other levels of the model, particularly the aspects of learning, transfer and impact.
Practical implications
The author has applied the model successfully in several public and private organisations, in industry and in the services sector, which demonstrates its usefulness and viability in evaluating the results of training. Therefore, this evaluation model has interesting and practical implications, as a useful tool for training managers for evaluating training results, as well as providing a global simplified approach to the complex evaluation function.
Originality/value
The originality of this evaluation model lies in its focus on a key and novel aspect – i.e. the pedagogical dimension, providing an integrated tool that can be easily adapted to any organisation.
Details
Keywords
Gonçalo Bernardino and Carla Curado
This study aims to investigate the formative evaluations of the training programmes of a Portuguese national railway public company for an entire calendar year. The aim is to…
Abstract
Purpose
This study aims to investigate the formative evaluations of the training programmes of a Portuguese national railway public company for an entire calendar year. The aim is to uncover alternative configurations for the design of training programmes to create better levels of evaluation. This study is based on the following research question: What are the configurations that lead to the success and or failure of trainers and trainees? Among those, are there any common designs that generate the success and or failure of both trainers and trainees?
Design/methodology/approach
This study used matched data from an entire calendar year to examine the trainers and trainees’ evaluations of 429 training events. This study also used a fuzzy-set qualitative comparative analysis (fsQCA) to provide configurations that generate the success or failure of trainers and trainees. This methodology offers alternative pathways to the same outcomes and thus gives managers different options to reach similar results.
Findings
The results show that there are more configurations that lead to trainers’ success (five) than to its absence (four). However, the configurations that lead to trainees’ success (three) are less than those that lead to its absence (six). The findings indicate that a single common configuration exists that leads to high evaluations.
Research limitations/implications
This study does not address summative evaluations. Regarding data, the study acknowledges the use of self-evaluations for trainees, although they serve as a proxy for a learning evaluation. The generalisation of the results outside the Portuguese railway company’s context is not possible.
Practical implications
The proposed analysis is applicable to other settings without restrictions. Managers may replicate this study’s approach in their organisations to uncover the alternative configurations that lead to the success or failure of trainers and trainees. They may adopt the ones that lead to successful outcomes and avoid the ones that lead to undesired ones.
Originality/value
This study is innovative because it addresses concurrently the success or failure of trainers and trainees that is only possible by using the fsQCA method. This study opted to use this method to provide alternative pathways to extreme outcomes: the most successful or the most unsuccessful. These multiple pathways are better results compared to traditional quantitative statistical methods that only provide a single estimated solution to the presence of the dependent variable; for example, a regression analysis or structural equation modelling.
Details
Keywords
The purpose of this study is to describe the evaluation of a training programme in a Portuguese family’s small and medium enterprise (SME) in the cosmetics industry. This study…
Abstract
Purpose
The purpose of this study is to describe the evaluation of a training programme in a Portuguese family’s small and medium enterprise (SME) in the cosmetics industry. This study addresses the four levels of the Kirkpatrick Model and estimates the return on investment (ROI) of a training programme in sales.
Design/methodology/approach
The study follows a case design to address the analysis of the training outcomes. This study uses data from 53 employees and explore the programme’s results.
Findings
This study provides evidence on the reactions of the trainees to the programme; the learning which results from it; and on the changes in trainees’ behaviours and the consequent results. This study also estimates the ROI of the programme; it is 5.55.
Research limitations/implications
The limitations to this study may be the use of data from a single training programme.
Practical implications
The research results offer managers some critical information in terms of future options in resource allocation. Training managers become more informed in making future choices on where to invest in training programmes.
Originality/value
The originality of the study regards the ROI estimation for an SME’s sales training programme. SMEs are not often addressed in the training evaluation literature. Because SMEs have limited organisational resources, and they do not invest much in training. Further, this estimation requires data gathering and reporting that is not commonly done, even for large firms.
Details
Keywords
Roger A. Plant and Robert J. Ryan
At a time when industrial expense is under great pressure,particularly training budgets, it is of great importance that trainingis carefully focused, to ensure that organizations…
Abstract
At a time when industrial expense is under great pressure, particularly training budgets, it is of great importance that training is carefully focused, to ensure that organizations obtain the maximum benefit. The widely accepted procedures for evaluation described by Donald Kirkpatrick almost without exception have been applied only at level 1 (Student Reaction forms). Many researchers have questioned the value of this part‐application of an evaluation strategy. This new system of training effectiveness evaluation not only forms the basis of individual analysis, but also allows group deficiencies to be explored over time. The method based on self‐perceived skill gap measurement allows the monitoring of skills management at individual departmental and organizational levels and gives management, for the first time, a control measure to which skill management budgets (of which training is a part) can be compared.
Details
Keywords
Philip Lewis and Adrian Thornhill
Recognizes the difficulties of evaluating training and argues that whatis required to make it more effective is the adoption of an integratedapproach to evaluation and, most…
Abstract
Recognizes the difficulties of evaluating training and argues that what is required to make it more effective is the adoption of an integrated approach to evaluation and, most significantly, the creation of an appropriate organizational culture, which promotes and recognizes the value of evaluation in general and training evaluation in particular. Discusses reasons for the absence of, or ineffective practice of, evaluation within so many organizations and these are shown to be related to organizational cultures which discourage training evaluation, especially organizational‐level evaluation. Discusses the nature and meaning of organizational culture from a practical point of view before providing advice to those responsible for training about how they can attempt to change an organization′s culture towards one which supports and values the evaluation of training.
Details
Keywords
Jonathan Passmore and Maria Velez
The purpose of this paper is to critically review existing models for evaluating organizational human resource (HR) interventions and to develop a practical but robust model for…
Abstract
Purpose
The purpose of this paper is to critically review existing models for evaluating organizational human resource (HR) interventions and to develop a practical but robust model for use by practitioners and researchers.
Design/methodology/approach
A literature review was undertaken of existing models developed to evaluate organizational HR interventions. Based on these a new model was developed.
Findings
The paper suggests that many of the existing models are either outdated or lack practical focus. The SOAP‐M model offers five levels for evaluation, four suitable for HR professionals and a fifth level for researchers.
Research limitations/implications
The paper is conceptual and the model needs to be tested by organizations to assess whether this has utility for HR practitioners.
Practical implications
The model offers a framework for conducting evaluations of organizational interventions and encourages HR practitioners to improve their practice by conducting robust evaluations of the interventions they use.
Originality/value
The paper offers a new and previously unpublished model, which could help HR practitioners improve their use of evaluation.
Details
Keywords
Raphael Papa Kweku Andoh, Elizabeth Cornelia Annan-Prah, Emmanuel Afreh Owusu and Paul Mensah Agyei
Training evaluation is an important part of training programs and evaluating the reactions of trainees is of immense value, but there are few studies on this level of evaluation…
Abstract
Purpose
Training evaluation is an important part of training programs and evaluating the reactions of trainees is of immense value, but there are few studies on this level of evaluation, as it is a neglected area of research. More so, when trainee reactions to training are poor, human resource managers together with learning and development professionals are able to improve on training programs. Nonetheless, no study has focussed on the aversions of trainees to training, and so this study aims to investigate the aversions of trainees regarding employee training.
Design/methodology/approach
This study uses the exploratory research design and obtains data from trainees in an online survey using an open-ended question. Thematic text analyses of the statements of 118 respondents are performed using a two-level coding process.
Findings
A total of 15 first-level codes are identified from the texts and categorized into five second-level codes. Further analyses culminate in the identification of two broad themes; trainers’ presentation aversions and organization of training aversions.
Practical implications
Attention must be given to the aversions of trainees in the training evaluation literature. This is because of the considerable amount of information that can be generated and based on that, identify the weaknesses inherent in employee training programs and ultimately improve this critical human resource function within organizations. In attending to the trainee aversions, the least and most reported should be resolved holistically for training objectives to be achieved.
Originality/value
Trainee reaction studies are scarce in the training literature. In addition, most of the existing trainee reaction studies focus on satisfaction while using closed-ended questionnaires. To the best of the authors’ knowledge, this is the first study that focuses on the aversions of trainees and which uses an open-ended question.
Details