Search results

A meta-evaluation is an assessment of evaluation practices. Meta-evaluations include assessments of validity and usefulness of two or more studies that focus on the same issues. Every performance audit is grounded explicitly or implicitly in one or more theories of program evaluation. A deep understanding of alternative theories of program evaluation is helpful to gain clarity about sound auditing practices. We present a review of several theories of program evaluation.

This study includes a meta-evaluation of seven government audits on the efficiency and effectiveness of tourism departments and programs. The seven tourism-marketing performance audits are program evaluations for: Missouri, North Carolina, Tennessee, Minnesota, Australia, and two for Hawaii. The majority of these audits are negative performance assessments. Similarly, although these audits are more useful than none at all, the central conclusion of the meta-evaluation is that most of these audit reports are inadequate assessments. These audits are too limited in the issues examined; not sufficiently grounded in relevant evaluation theory and practice; and fail to include recommendations, that if implemented, would result in substantial increases in performance.

The purpose of this paper is to focus on the analysis of the characteristics and gaps of a literature fragment from the international scientific publications on performance evaluation in lean production, aiming to generate new knowledge and suggestions for future scientific research.

The authors have adopted “ProKnow-C” methodology, a qualitative research approach that is used for literature selection, identification, analysis and reflection on the established characteristics.

From a bibliographic portfolio of 67 research works, 91 per cent of the works have individual metrics and 84 per cent have sets of metrics. Evaluating the focus of the performance measurement system, 34 per cent of works measure performance, 43 per cent compare performance and only 18 per cent assist in strategic planning. Evaluating the phases of the PMS life cycle, 87 per cent attend to the design, and 66 per cent attend to the activities of data collection, allow diagnosis, evaluate performance and communicate results. However, only 3 per cent of the studies analysed the use of PMS after its implementation and no research evidenced the review of metrics and objectives based on strategic planning.

The search formula to capture the bibliographic portfolio (BP) was limited to the following terms: performance measurement, performance evaluation, performance assess*, performance appraisal, management, indicator*, critical factors, best practices, lean production, lean manufacturing and lean system. The BP was determined based on the limitations set by the research authors: articles published in English and Portuguese languages, from 2000 to 2018, in the Engineering Village, Scopus, EBSCO, Web of Science, ProQuest and Science Direct databases, which were freely available on the internet. Lastly, conceptual knowledge was used to select the articles, so there is a chance that unintentional losses could happen.

As practical implications for practitioners, the authors have identified that a PMS from an organisation that aims to become “lean” needs to be defined and revised considering its strategy, adjusting its set of metrics and targets to the internal and external challenges. As practical implications for researchers, opportunities have been identified to develop longitudinal studies in PMS utilisation and review to understand how the measurement system must evolve over time through changes in the internal and external environments of organisations.

This research adds value because its results allow researchers and practitioners to visualise the boundaries of the knowledge from the BP, about performance management in lean production, and what their gaps are in relation to the reference model of performance evaluation. This research is original because it was not observed in the literature review, a research that used the ProKnow-C methodology for analysis of the alignment and gaps between lean production and performance evaluation.

The purpose of this paper is to know what scientific literature presents about the theme evaluation of seaport performance, thus enabling the construction of knowledge in the researchers and the identification of gaps in the research that will lead to advances in the area from the identification of the characteristics of a portfolio of relevant international publications.

From the basic philosophical (constructivism), of the kind strategy (research-action) and the method used for the accomplishment of such strategy (structured process knowledge development process – constructivist (ProKnow-C)) the current research has a qualitative approach.

From the analysis of the bibliographic portfolio composed of 23 articles, the main results were: focus of the evaluation of seaport performance is on operational and tactical efficiency rather than on strategic and global performance; the majority of the studies does not relate to the reality experienced by seaport managers due to the limited interaction with these managers, evidencing a distance of the researchers from the object of their research; and performance evaluation was barely used/explored as a tool to support management, only for the sake of evaluation itself.

The search occurred in the databases Web of Science, Scopus, Proquest, Ebsco, Sciece Direct and Wiley.

The identification of gaps that might promote advances in this field of knowledge, once the seaport segment is not exploring the potential that performance evaluation can offer and is already available in literature.

This study explores how balanced scorecard format and reputation from environmental performances interact to influence performance evaluations.

Two general options exist for inserting environmental measures into a scorecard: embedded among the four traditional perspectives or grouped in a fifth perspective. Prior balanced scorecard research also assumes negative past environmental performances. In such settings, and when low management communication levels exist on the importance of environmental strategic objectives (a common practitioner scenario), environmental measures receive less decision weight when they are grouped in a fifth scorecard perspective. However, a positive environmental reputation would generate loss aversion concerns with reputation, leading to more decision weight given to environmental measures. Participants (N=138) evaluated performances with scorecards in an experimental design that manipulates scorecard format (four, five-perspectives) and past environmental performance operationalizing reputation (positive, negative).

The environmental reputation valence’s impact is more (less) pronounced when environmental measures are grouped (embedded) in a fifth perspective (among the four traditional perspectives), when the environmental feature of the measures is more (less) salient.

Findings provide the literature with original empirical results that support the popular, but often anecdotal, position of advocating a fifth perspective for environmental measures to help emphasize and promote environmental stewardship within an entity when common low management communication levels exist. Specifically, when positive past environmental performances exist, entities may choose to group environmental performance measures together in a fifth scorecard perspective without risking those measures receiving the discounted decision weight indicated in prior studies.

In today’s digital economy, it is very important to cultivate digital professionals with advanced interdisciplinary skills. The purpose of this paper is that universities play a vital role in this effort, and research teams need to use the synergistic effect of various educational methods to improve the quality and efficiency of personnel training. For these teams, a powerful evaluation mechanism is very important to improve their innovation ability and the overall level of talents they cultivate. The policy of “selecting the best through public bidding” not only meets the multi-dimensional evaluation needs of contemporary research, but also conforms to the current atmosphere of evaluating scientific and technological talents.

Nonetheless, since its adoption, several challenges have emerged, including flawed project management systems, a mismatch between listed needs and actual core technological needs and a low rate of conversion of scientific achievements into practical outcomes. These issues are often traced back to overly simplistic evaluation methods for research teams. This paper reviews the literature on the “Open Bidding for Selecting the Best Candidates” policy and related evaluation mechanisms for research teams, identifying methodological shortcomings, a gap in exploring team collaboration and an oversight in team selection criteria.

It proposes a theoretical framework for the evaluation and selection mechanisms of research teams under the “Open Bidding for Selecting the Best Candidates” model, offering a solid foundation for further in-depth studies in this area.

Research progress on the Evaluation Mechanism of Scientific Research Teams in the Digital Economy Era from the Perspective of “Open Bidding for Selecting the Best Candidates.”

The aim of this chapter is to investigate the relationship between the uses of budgets with financial performance in start-ups’ business environment. For this reason, an empirical survey was carried out, using a questionnaire in 134 start-up companies, which are based in 10 different European countries. Results show that there is a positive association between the use of budgets for planning, resource allocation and performance evaluation with financial performance. The CEO’s business educational background, as well as CEO’s beliefs about planning, has a strong influence in the use of budgets in start-up firms. We also concluded that there is a positive association between perceived environmental uncertainty (PEU) and the use of budgets for planning and resource allocation and a negative association between PEU and the use of budgets for performance evaluation.

The topic of employees’ unethical pro-organizational behavior (UPB) has attracted more and more interest in both practice and academic fields. However, previous studies have mainly investigated the antecedents of UPB and little research has discussed the outcome variables. This study aims to provide a comprehensive understanding of the effect mechanism of UPB on employee performance evaluation rated by a supervisor through a leader-member exchange (LMX) and the moderating role of supervisor bottom-line mentality (BLM).

This study used a sample consisting of 304 employees and 96 supervisors in several manufacturing firms in China. The authors used hierarchical linear modeling to test the hypotheses, as this was cross-level research. In addition, this paper also uses Mplus7.4 to test the moderating effects of supervisor BLM on the indirect effects between the UPB and performance evaluation by a moderated path analysis.

The results confirm that UPB is positively related to performance evaluation rated by supervisors. Additionally, the mediating effect of LMX in the relationship between UPB and performance evaluation is successfully demonstrated. Furthermore, supervisor BLM cross-levelly moderates the relationship between UPB and LMX, as well as moderates the mediation effect of LMX on the correlation between UPB and performance evaluation.

The primary contribution of this research is building a cross-level model for the effect of UPB on followers’ performance evaluation scored by the supervisor and thereby extending the nomological networks of both UPB and performance evaluation literature. Another contribution the study makes to the literature is that it provides a new perspective to understand how UPB relates to followers’ performance evaluation.

This is the first study about how and when UPB predicts followers’ performance evaluation rated by the supervisor.

High‐tech industry has been the principal economic source for Taiwan in recent years. The characteristics of high‐tech industries in Taiwan are changeable product markets, short product life cycles and high company attrition rate. In the globalization trend, the high‐tech industry has gradually increased corporate competitiveness and reached the goal of sustainable operations through knowledge management, knowledge sharing and new product research and development. Firms have aggressively strengthened and integrated their internal and external resources and enhanced knowledge sharing to increase industry operational performance. Effectively strengthening the knowledge management operation and performance evaluation of knowledge sharing in Taiwan’s high‐tech industry has become a critical issue. In the selection of knowledge sharing Key Performance Indicators (KPI), this research divided the knowledge sharing indicators into representative strategic indicators such as organizational knowledge learning, organizational knowledge resources, organizational information capacity and organizational knowledge performance through screening using Factor Analysis. The characteristics of the constructs were interdependent. This research calculated and adjusted the correlation among the key performance knowledge sharing indicators using ANP and determined the relative weight of knowledge sharing.

The purpose of this paper is to develop an integrated dynamic model, based on empirical findings, which can be used in research centers for evaluating the performance of research projects by using multiple attribute utility theory.

In developing the model, the measures by which the performance of research projects could be evaluated are identified by Delphi method and group decision making. These measures are categorized into three general success factors of time, cost and quality. Then a multi‐attribute utility function is applied to integrate these dimensions to determine the utility resulting from the performance of the project.

Through literature review it is evident that some evaluation techniques such as checklists, scoring models, analytical hierarchy process and engineering economic techniques have been developed for evaluating performance of projects. The present model complements and improves upon the existing models.

The parameters of model are determined based on research center's policy but they may be changed for other research centers. So the model depends on the expert's view. The model is not considered advantageous in situations where project gets ahead of program.

The model is tested in an engineering research institute and the comparison is made with the results of the existing models.

The advantage of proposed model is its flexibility, dynamism and the capability to revise the model based on any changes in the objectives and policies of the research center.

Interest in the nature of influence attempts in the performance evaluation process has increased in recent years. Researchers have conducted a number of important and revealing cross‐sectional investigations, but there remains virtually no longitudinal work in this area. The present study attempted to address this need by conducting a multi‐period investigation of influence tactics use and affect that addressed three questions: (1) Are individuals consistent in their use of influence tactics across evaluation periods? (2) Are prior‐period performance ratings reflected in subsequent influence tactic use? (3) What role does affect, both supervisor and subordinate, play in this process? A latent variable structural model was tested using longitudinal data from managers and employees of food services units. Our results indicated that there is a cycle of continued influence tactic use across time periods, performance ratings help to determine subsequent tactic use, and both supervisor and subordinate affect play a role in the influence‐evaluation process. Implications of these results and directions for future research are discussed.