Search results

Through the perspectives of a project director/principal investigator and external evaluator, this chapter explores the methods, strategies, and processes used to design and conduct ongoing, comprehensive evaluation of the Math and Science Teacher Initiatives at California State University, Dominguez Hills. Initiatives include an undergraduate program for students interested in STEM teaching careers, multiple alternative route programs to teacher certification in math and science and a fellowship program for master science teachers. Using a collaborative evaluation framework (O’Sullivan, 2004), the authors highlight the benefits of conducting multiprogram evaluation from a collaborative lens and describe the systematic processes used to engage stakeholders, from the design phase of the evaluation through data collection, analysis, and reporting of participant impact and outcomes. The strengths of the program and evaluation approach, along with specific strategies and methods utilized, will be explored. The chapter will conclude with challenges, lessons learned, and best practices, as well as implications for the field of teacher education and leadership within a STEM context.

Through the scientific and reasonable evaluation of the site selection of the emergency material reserve, the optimal site selection scheme is found, which provides reference for the future emergency decision-making research.

In this paper, we have chosen three primary indicators and twelve secondary indicators to construct an assessment framework for the determination of suitable locations for storing emergency material reserves. By mean of the improved entropy weight-order relationship weight determination method, the evaluation model of kullback leibler-technique for order preference by similarity to an ideal solution (KL-TOPSIS) emergency material reserve location based on relative entropy is established. On this basis, 10 regional storage sites in Beijing are selected for evaluation.

The results show that the evaluation model of the location of emergency material reserve not only respects the objective knowledge, but also considers the subjective information of the experts, which makes the ranking result of the location of the emergency material reserve more accurate and reliable.

Firstly, the modification factor is added to the calculation formula of traditional entropy weight method to complete the improvement of entropy weight method. Secondly, the order relation analysis method is used to assign subjective weights to the indicators. The principle of minimum information entropy is introduced to determine the comprehensive weight of the index. Finally, KL distance and TOPSIS method are combined to determine the relative entropy and proximity degree of alternative solutions and positive and negative ideal solutions, and the scientific and effective of the method is proved by case study.

Evaluating emergency preparedness exercises is crucial for assessing enhanced knowledge, facilitating learning and implementing knowledge in organizations. The cognitive process of motivation for action is a precursor for action, coping behavior and individual learning. This study aims to focus on how guided evaluation of emergency preparedness exercises can enhance cognitive motivation and influence the mental readiness of exercise participants.

This is a conceptual paper with a model approach design. The main conceptual contribution is suggesting a model for guided evaluation in emergency preparedness exercises. We present a theoretical background for understanding the increase in motivation based on social cognitive learning theory. In particular, this study discusses how different evaluation steps contribute to enhanced motivation and learning for exercise participants.

Increased motivation and enhanced personal performance standards could be achieved through using processes that lead to self-efficacy in guided exercise evaluation. Specifically, sources of enhanced motivation, such as repeated coping experiences, self-regulation processes, mastery motivation and performance motivation, would proliferate the readiness of individual crisis managers and teams.

This article suggests an evaluation model for use in emergency preparedness exercises. This approach combines bottom-up and top-down processes for debriefing, reflection and feedback, both individually and in teams. This approach aims to enhance exercise participants’ motivation and utilize exercise evaluation for organizational learning.

The conceptual discussion leads to developing implications for evaluation practice, suggesting how to structure evaluation and why. This study is novel for its explanation of how to use evaluation in the learning process.

The European Union (EU) Medical Device Regulations (MDR) 2017/745 entered into force on May 2021 with changes related to strengthening the clinical evaluation requirements, particularly for high-risk devices. This study aims to investigate the impact of these strengthened requirements on medical device manufacturers by investigating the challenges they encounter while generating an MDR-compliant clinical evaluation report.

A systematic literature review was carried out using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses method of peer-reviewed literature and various government jurisdictional reports and legislation.

The findings from the study understanding what constitutes sufficient clinical evidence poses the biggest challenge to the generation of an MDR-compliant clinical evaluation report. Resulting from the challenges they are facing, manufacturers of certain CE-marked medical devices are planning to remove (and have removed) devices from the EU market upon expiration of their certificate, and in the case of new and innovative devices, some manufacturers are planning to launch in other markets ahead of the EU. These challenges will lead to a potential shortage of certain medical devices in the EU and a delay in access to new devices, thereby negatively impacting patients’ quality of life.

This study provides a unique insight into the challenges currently experienced by medical device manufacturers as they transition to the MDR clinical evaluation requirements and the subsequent impact on the continued availability of medical devices in the EU. A limitation is the lack of literature analysing the regulations and their effects.

This study has both theoretical contributions in that, to the best of the authors’ knowledge, it is the first detailed and systematic review of the new MDR Regulations and has implications for practice as manufacturers and policymakers can leverage it alike to understand the challenges of the new MDR.

The main aim of this paper is to establish a reasonable and scientific evaluation index system to assess the high quality and full employment (HQaFE).

This paper uses a novel Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) multi-criteria framework to evaluate the quality and quantity of employment, wherein the integrated weights of attributes are determined by the combined the Criteria Importance Through Inter-criteria Correlation (CRITIC) and entropy approaches.

Firstly, the gap in the Yangtze River Delta in employment quality is narrowing year by year; secondly, employment skills as well as employment supply and demand are the primary indicators that determine the HQaFE; finally, the evaluation scores are clearly hierarchical, in the order of Shanghai, Jiangsu, Zhejiang and Anhui.

A scientific and reasonable evaluation index system is constructed. A novel CRITIC-entropy-TOPSIS evaluation is proposed to make the results more objective. Some policy recommendations that can promote the achievement of HQaFE are proposed.

Since the present university leading cadre capability evaluations are mainly static, there is a lack of evaluation methods to address dynamic and multi‐scale‐based situations. Some important factors to address people's performances, such as the developing trends and potentialities are considered. The purpose of this paper is to attempt to propose a dynamic evaluation model based on multivariate delay connection number.

First, evaluation results of previous periods are taken into the current period and values of uncertain numbers are revised. Next, a dynamic evaluation model is built for university leading cadre. Last, a numerical example is used to prove its feasibility and effectiveness.

This paper promotes a corrected equal portion value method of uncertain numbers i1(τ), … ,in(τ) from the adjacent two periods to multi periods, and builds a dynamic evaluation model, which proved simple‐structured and easy to apply.

The new model is applied in the evaluation of university leading cadre, and could give a more comprehensive, dynamic, scientific analysis for evaluation by model application.

The paper develops a novel evaluation model based on a multivariate delay connection number, which expands traditional methods from a static situation to a dynamic and multi‐scale‐based situation.

The evaluation of maintenance tenders is a task that involves not only consideration of the prices offered, but the financial and technical expertise of the tenderers as well. The evaluations can be highly complicated and lengthy when dealing with large projects and numerous tenderers. Presents an evaluation methodology in the form of a tabular procedure to be used by the evaluators of maintenance contracts. Develops seven tables to provide quantitative values for the submitted tenders. The first five tables are designed to evaluate the technical efficiency of the tenderers, while the sixth table is designed for the final evaluation including prices. In the first table, the tender compliance as per the requirement of the tender document is evaluated. Uses the second table to evaluate the support and maintenance plan. The third table presents an evaluation of the experience and the financial status of the tenderer. The fourth and fifth tables are used to evaluate the tenderer’s staffing proposal and how it is related to the requirements of the project. The sixth table summarizes the evaluation of the previous four tables for each evaluator. The seventh table illustrates the final evaluation of each tenderer, and hence a decision could be made. By adding the average technical score of each tenderer to his price score, the evaluator can easily rate each tenderer’s ability to carry out the work rather than depending only on price, which might not always mean a good choice.

The purpose of this paper is to characterize performance evaluation dynamics developed in Lisbon Municipal Libraries Network (LMLN) over a two-decade period (1989-2009), using a specific model and tools of (meta-)analysis.

Based on a methodology eminently qualitative supported by a combination of research methods (literature review, construction and application of conceptual models for analysis and case study), the author examined LMLN's performance evaluation progress, focusing on the diachronic study of evaluative processes – the performance evaluation dynamics.

Between 1989 and 2009, LMLN developed four main performance evaluation dynamics. The most significant results that emerged from the examination of these dynamics relate to the following elements of the model of analysis Dynamics and Impacts of Library Performance Evaluation (DILPE): evaluation objects and methods; organization; and dissemination of results. The study also emphasized the importance of some factors to dynamics sustainability: the presence of a permanent coordination team, in the direct dependency of the head of library services, with the right competences; the existence of a culture of assessment; and the commitment of leadership with performance evaluation.

The meta-evaluative approach and particularly the focus on the long-term development of evaluative theories and practices, contributes to the enlargement of the international corpus on library performance evaluation. On the other hand, the analytical model and conceptual tools created might be useful to other researchers/practitioners willing to meta-evaluate library performance evaluation dynamics.

Introduces a method of food sensory evaluation employing artificial neural networks. The process of food sensory evaluation can be viewed as a multi‐input and multi‐output (MIMO) system in which food composition serves as the input and human food evaluation as the output. It has proved to be very difficult to establish a mathematical model of this system; however, a series of samples have been obtained through experiments, each of which comprises input and output data. On the basis of these sample data, applies the back‐propagation algorithm (BP algorithm) to “train” a three‐layer feed‐forward network. The result is a neural network that can successfully imitate the food sensory evaluation of the evaluation panel. This method can also be applied in other fields such as food composition optimizing, new product development and market evaluation and investigation.

Performance measurement and programme evaluation have been promoted as a central mechanism of recent Australian public sector (APS) reform. Outlines recent reforms in the APS and identifies links between evaluation and performance information. Identifies the major issue of credibility, when performance information is produced internally and not verified externally. A lack of performance systems and standards can create difficulties for both internal and external programme evaluations. Concludes that: reforms introduced to evaluate performance in the APS were promoted with high expectations which have only partially been fulfilled; the present system is internally focused with a narrow role for evaluation and a lack of credibility because of the independence issue; the present systems associated with the performance approach and its evaluation are not providing enough information to deal with the tough questions of the effectiveness of government programmes. Proposes that a middle ground between internal and external programme evaluation strategies be adopted. This allows the strengths of internal evaluation to be retained. At the same time, it allows the possibility of improving programme evaluation by adding external independent verification and an extended effectiveness role.