Search results

The authors compare perspectives on external evaluation of health service provision between Norway and the USA. External inspection and accreditation are examples of internationally wide-spread external evaluation methods used to assess the quality of care given to patients. Different countries have different national policy strategies and arrangements set up to do these evaluations. Although there is growing attention to the impact and effects on quality and safety from external evaluation, there is still a gap in knowledge to how structures and processes influence these outcomes. Accordingly, the purpose of this article is to describe the structures and processes in external evaluation designed to promote quality improvement in Norway and the USA with attention to comparison of enablers and barriers in external evaluation systems.

Data collection consisted of documentary evidence retrieved from governmental policies, and reviews of the Joint Commission (the US), international guidelines, recommendations and reports from the International Society for Quality in Health Care, and the World Health Organization, and policies and regulations related to Norwegian governmental bodies such as the Ministry of Health and Care Services, the Norwegian Directorate of Health, and the Norwegian Board of Health Supervision . Data were analyzed inspired by a deductive, direct content analytical framework.

The authors found that both accreditation and inspection are strategies put in place to ensure that healthcare providers have adequate quality systems as well as contributing to the wider risk and safety enhancing management and implementation processes in the organizations subjected to evaluation. The US and the Norwegian external regulatory landscapes are complex and include several policymaking and governing institutions. The Norwegian regulatory framework for inspection has replaced an individual blame logic with a model which “blames” the system for inadequate quality and patient harm. This contrasts with the US accreditation system, which focuses on accreditation visits. Although findings indicate an ongoing turning point in accreditation, findings also demonstrate that involving patients and next of kin directly in adverse event inspections is a bigger part of a change in external inspection culture and methods than in processes of accreditation.

The message of this paper is important for policymakers, and bodies of inspection and accreditation because knowledge retrieved from the comparative document study may contribute to better understanding of the implications from the different system designs and in turn contribute to improving external evaluations.

Although there is a growing attention to the impact and effects on quality and safety from external evaluation, the implications of different regulatory strategies and arrangements for evaluation on quality and safety remain unclear.

This study aims to examine the influence of the following on the quality of externally facilitated board evaluation, namely, the timing of adoption of external board evaluation, type of evaluators and the independence of external facilitators.

The statements on board evaluation in annual reports of a sample of FTSE 350 companies were content analysed to measure the quality of externally facilitated board evaluation. This paper then used descriptive analysis and inferential statistics to demonstrate the possible association between the timing of adoption, as well as the type and independence of external facilitators and the quality of externally facilitated board evaluation.

Results reveal some effects of the timing of adoption, as well as the type and independence of external facilitators on the quality of externally facilitated board evaluation.

Shareholders should be aware of the timing of adoption, as well as consider the types and independence of external facilitators, given their influence on the quality of externally facilitated board evaluation. Regulatory authorities should provide more specific guidance on what types of professional organisations can be engaged as external facilitators and on the implementation of externally facilitated board evaluation, to promote its quality.

Several studies have provided theoretical accounts on how board evaluation should be conducted to ensure its effectiveness. However, there is a dearth of empirical literature, which examines the quality of externally facilitated board evaluation. This study develops a quality measure for externally facilitated board evaluation and shows the effect of the timing of adoption, types and independence of external facilitators on its quality. The study forges ahead institutional theorising of external board evaluation.

Many industries are increasingly affected by or even invite the participation of external stakeholders in the innovation process. The concepts of open innovation use the ideas of external stakeholders to foster innovation and make the firms more competitive. However, little research has considered whether evaluations from external stakeholders also serve as a source for open innovation and, and if so, in which way they are integrated into the innovation process. Thus, the purpose of this paper is to explore how external evaluations influence the innovation process in the creative industries.

The authors conducted an explorative qualitative study using a mixture of an inductive and deductive research design. The authors interviewed 14 artists in order to understand how external evaluations are integrated in the innovation process.

The paper formulates propositions on factors that influence whether and how external evaluations are a resource for the innovation process in micro-firms. The factors are the situation of the individual that is evaluated, the external evaluator’s credibility, the content of the evaluation, and the potential impact of the evaluation on the individual evaluated.

This paper provides exploratory insights into a so far neglected source of open innovation and its external evaluations in micro-firms in the creative industries.

Increased investments in employee further training have resulted in a growing interest in ensuring and improving the quality of these measures. However, little is known about the operational decision to initiate an evaluation of further training. Therefore, the purpose of this paper is to investigate under which circumstances firms decide to evaluate training measures.

The study analyzes the evaluation decision of firms and external suppliers, and differentiates between internal and external further trainings. Theoretically, two goals of evaluations – monitoring and feedback – and their relevance for the decision makers are considered. Using a unique linked employer–employee data set, the study employs multi-level models to analyze three influencing factors on the evaluation decision: characteristics of the further training measure itself, the employees and the employers.

The results show that evaluation decisions are not based on general organizational practices but on case-by-case cost-benefit considerations. Interestingly, firms are more likely to evaluate internal further training measures than external ones. Therefore, evaluations seem to be more frequently used as a feedback instrument than for the purpose of monitoring. For external further training measures, firms seem to trust market mechanisms as a monitoring instrument, instead of conducting an internal evaluation.

Although further training has become increasingly important, little is known about firms’ quality management in this respect. This paper provides a theoretical framework for the usage of evaluation procedures and analyzes firms’ strategies for ensuring quality based on a large set of variables to give new insight into the organizational decision-making processes.

The main purpose of this paper is to examine more closely the tension between, on the one hand, forms of internal school improvement based on internal evaluation measures and, on the other hand, control and legitimisation needs grounded on external evaluation measures.

The clash of these forms of evaluation is at the core of the paper, dealing in particular with the changing evaluation systems in the Cypriot education system. Therefore, the case study approach is utilised here. More specifically, the case of Cyprus is used as a system under transition in order to move from a primarily teacher inspection system, which is externally driven, to a combination of a teacher/school inspection system, which is based on both external and internal processes and is directed at both formative and summative evaluation processes.

It is asserted that the new proposed appraisal system for Cyprus addresses the deficiencies of the current evaluation system and generally aims at achieving a balance between external and internal processes. Finally, the conditions for the acceptance and successful implementation of new evaluation systems are described.

The results of the study constitute a rich setting of future developments for Cyprus schools with regard to important issues such as school accountability, school improvement, teacher evaluation, internal school evaluation and external inspection, through the proposed appraisal system. Therefore, the paper provides an important source of information for those who have the responsibility of creating educational policy and planning for the years to come in the area of teacher appraisal.

In Saudi Arabia, technical education is managed by Technical and Vocational Training Corporation. However, there is no independent accrediting body to accredit the technical institutes and assure its quality, which causes the lack of unified quality assurance standards and manageable quality improvement processes. The purpose of this paper is to propose self-evaluation standards to help the technical institutes to evaluate their performance.

The author has used a brainstorming technique of local practitioners in quality assurance. Such technique was performed by adopting DACUM that stands for “Developing A CurriculUM”. The author has used a heuristic educational and training process as the foundation of the standards and processes development, namely; curriculum, environment, training managements, and instructors. A team has been established that has been trained locally and abroad on the quality assurance standards and processes. The team studied several quality frameworks of the different countries to come up with guidelines for quality self-evaluation and standards.

The author has found that such an approach is a very effective tool for improving the institutes' performance and gives them the flexibility to decide about their missions. Most of institutes' staff is reluctant to participate in the self-evaluation process because of the fear it may reveal their weaknesses, but with encouragement and motivation especially from the top management they tend to participate in such a process. Self-evaluation helps the educational institutes to be benchmarked with other international institutions, in which good practices may be adopted by the institutes' managements to achieve their vision.

The proposed approach can help the technical education institutes to manage their quality system. In addition, the implementation of such an approach might be the starting point to develop a quality system framework for the technical education in Saudi Arabia. However, further investigation is needed to measure whether applying such standards may help the technical education institutes to meet the required quality standards to attain an accreditation from the international quality agencies.

The proposed guidelines for quality standards and processes is a contribution in the accreditation and quality assurance processes for many public and private institutions in Saudi Arabia. In addition, it is an important step to standardize the quality processes.

This paper aims to examine how board evaluations have emerged as an important tool in public policy and corporate practice for enhancing board effectiveness.

The authors review the extensive literature on effectiveness and the emerging literature on board evaluation to identify ways to assess the current policy direction for external evaluation of corporate boards.

The paper develops an integrated framework of effectiveness that can be used as a tool for board evaluation, in particular for externally facilitated exercises.

Through its integration of prior conceptual work this paper advances our theoretical understanding of this emerging part of policy and practice, with to-date lack much empirical basis.

The framework that is developed shows ways to focus how the practice is conducted by boards and external evaluators alike.

It can also help policy formation by pointing out the limitations as well as benefits of various policy options.

In pointing to ways to develop study of the field through empirical research, it provides direction for future academic research. It also identifies a need for and direction toward the professionalization of practice.

Performance measurement and programme evaluation have been promoted as a central mechanism of recent Australian public sector (APS) reform. Outlines recent reforms in the APS and identifies links between evaluation and performance information. Identifies the major issue of credibility, when performance information is produced internally and not verified externally. A lack of performance systems and standards can create difficulties for both internal and external programme evaluations. Concludes that: reforms introduced to evaluate performance in the APS were promoted with high expectations which have only partially been fulfilled; the present system is internally focused with a narrow role for evaluation and a lack of credibility because of the independence issue; the present systems associated with the performance approach and its evaluation are not providing enough information to deal with the tough questions of the effectiveness of government programmes. Proposes that a middle ground between internal and external programme evaluation strategies be adopted. This allows the strengths of internal evaluation to be retained. At the same time, it allows the possibility of improving programme evaluation by adding external independent verification and an extended effectiveness role.

The question as to why it is necessary to evaluate an essentially evaluative exercise ‐ namely quality assurance ‐ is first examined. It is claimed that because quality assurance is not merely an assessment of health services but a strategic intervention into patient care and/or health care services there is a requirement to verify and monitor the type of quality assurance system being used. Such a requirement can be legitimised either on ethical grounds or on pragmatic grounds. The former position suggests that it is in fact wrong to employ systems whose efficacy and rigour is unproven and unmonitored while the latter position suggests that the potential fallout from a quality assurance programme that fails is of such magnitude that some form of evaluation ought to be undertaken as a matter of course. There follows an examination of some areas that one may want to consider in such an evaluation. These are based on the tripartite split of the elements of quality assurance found in Donabedian′s early work. Finally the question as to the relative merits of an evaluation contained within the quality assurance programme itself and one external to it is addressed.

The authors present the application of the López-Fresno approach in designing an integrated management system (IMS) for an aviation company to the development of an IMS in a government-run organization responsible for the medical evaluation of work disabilities. The purpose of this paper is to share the design process, with the intention of showing that this approach is applicable to other sectors and proposing generalization and applicability strategies to other smaller government entities.

The study involves two phases. Phase I applies the López-Fresno approach to design a basic IMS-I and ends with a European Foundation for Quality Management (EFQM) evaluation, whose suggestions were taken into consideration for the final design of IMS-II during phase II. The data were obtained from the organization's own functioning. There was a significant degree of personal involvement by the authors, external consultants and members of the management committee in areas ranging from the approach itself to the various components analyzed.

The approach led to a better use of human and material resources and produced various advances in both internal and external communication and significant progress in employee motivation in their dealings with users and stakeholders.

The study offers guidelines and recommendations for designing an IMS adapted to small, compact, administrative organizations that operate with stakeholders with highly disparate outlooks and interests, with different quality levels, in a context related to competitiveness and economic development.