Search results

The UK National Clinical Assessment Service (NCAS) provides local NHS bodies with advice and support in relation to concerns about individual doctors and dentists and in some cases also conducts a detailed assessment of practitioner performance. The purpose of this paper is to identify the contribution of NCAS performance assessment to clarifying concerns about clinical performance through comparison of concerns suspected at initial referral with those identified at assessment.

In the paper a sample of 50 NCAS medical cases, performance issues reported at the point of referral to NCAS and those identified at assessment were grouped into five broad domains (clinical care, behaviour, health, education and training, organisation). Concerns identified at assessment were compared with those reported at referral for each domain of concern. Conclusions and recommendations following assessment were also reviewed.

Within each domain, some concerns noted at referral were confirmed; others were challenged or redefined. In all areas, but particularly in respect of the work environment, new concerns were identified for the first time at assessment. In 20 percent of cases, the concerns identified at referral were not borne out at assessment. In 12 percent of cases the issues revealed at assessment were more serious than anticipated.

Findings indicate that the NCAS assessment process provides a more accurate and comprehensive “diagnosis” of performance issues, enabling more appropriate recommendations for “treatment” and helping to differentiate between potentially remediable and more fundamental problems.

There is currently little published evidence about the contribution of this type of performance assessment programme to clarifying performance issues.

Multinational companies have manufacturing operations in various countries; however, there is scarce evidence on how they assess performance of the network-based operations of their factories, called international manufacturing networks (IMN). The purpose of this paper is to propose a process model for the performance assessment of IMNs.

The IMN performance assessment process model was developed from the extant literature and was empirically verified in its congruency and usefulness via a multiple case research. For that, in each case the general process model was derived into a specific application that fit the type of IMN on focus. Qualitative and quantitative data were collected from the case companies’ reports, profiling forms and interviews, followed by within-case and cross-case analyses.

Evidence suggest that the process model, along with its derivations, is a valuable tool to describe and explain how IMN performance assessment unfolds in real organizational environments. Additionally, three propositions emerged: IMN performance assessment has distinct characteristics depending on the type of IMN adopted, which in turn depends on the company’s internationalization strategy; IMN performance assessment has more strategic value and importance for companies that are globally coordinated and adopt “rooted” manufacturing strategies; and companies design their IMN performance assessment on a trial-and-error basis.

As all case-based research, this paper has generalizability limitations. Thus, next steps may include a large-scale survey and an action research that will develop and implement a full-fledged IMN performance assessment.

The process model and descriptive insights provide a diagnostic tool and subsidies that may encourage managers to review and improve their current IMN performance assessment.

The process model contributes to addressing a 20-year gap concerning how to approach IMN performance assessment in a holistic and systematic manner.

The purpose of this paper is to unveil any underlying relationships between contractor inputs and performance outputs. The outcome of the reported study is intended to help identify the inputs, which have more significant impacts on contractor performance outputs and therefore, help formulate more reliable “upfront” (ex ante) performance assessment criteria, hence improving approaches to the contractor‐selection process.

A case study was conducted on the Performance Assessment Scoring System (PASS) of a large public client in Hong Kong to determine the Pearson product‐moment correlation between the scores of various input assessments and output assessments.

The findings revealed relationships between some of the input assessment scores and the output results. Emerging as positive, all the discerned relationships confirmed that better outputs did in fact relate well to better inputs.

The PASS system is designed to be very objective, hence the criteria and assessment of inputs may be restricted to easily measurable items. The sample size obtainable was small, but still considered to be adequate for this initial study.

Construction clients could choose to improve their contractor selection processes by identifying and incorporating contractor input factors that are seen to influence performance outputs. Contractors can also improve their outputs by focusing on the identified critical inputs.

Few studies have sought to discern relationships between contractor inputs and their performance outputs through a quantitative approach. This case study provided a methodology, incorporating a statistics‐based approach along with examples and explanations of how inputs can influence contractor outputs.

This study aims to investigate quality of feedback as offered by supervisor-assessors with varying levels of assessor expertise following assessment of performance in residency training in a health care setting. It furthermore investigates if and how different levels of assessor expertise influence feedback characteristics.

Experienced (n=18) and non-experienced (n=16) supervisor-assessors with different levels of assessor expertise in general practice (GP) watched two videotapes, each presenting a trainee in a “real-life” patient encounter. After watching each videotape, participants documented performance ratings, wrote down narrative feedback comments and verbalized their feedback. Deductive content analysis of feedback protocols was used to explore quality of feedback. Between-group differences were assessed using qualitative-based quantitative analysis of feedback data.

Overall, specificity and usefulness of both written and verbal feedback was limited. Differences in assessor expertise did not seem to affect feedback quality.

Results of the study are limited to a specific setting (GP) and assessment context. Further study in other settings and larger sample sizes may contribute to better understanding of the relation between assessor characteristics and feedback quality.

Findings suggest that even with supervisor-assessors with varying levels of assessor expertise who are trained in performance assessment and the provision of performance feedback, high-quality feedback is not self-evident; coaching “on the job” of feedback providers and continuous evaluation of feedback processes in performance management systems is crucial. Instruments should facilitate provision of meaningful feedback in writing.

The paper investigates quality of feedback immediately following assessment of performance, and links feedback quality to assessor expertise. Findings can contribute to improvement of performance management systems and assessments for developmental purposes.

In this study, the performance assessment of credit unions is developed, seeking to demonstrate how the content of their operations strategy is present in the structuring of unique models of organisational performance assessment. The main objective is to compare sources of knowledge through the content analysis of the service operations strategy as proposed by the literature and validated by specialists.

This research is a qualitative study that uses the knowledge of specialists to frame a performance assessment structure applied to credit unions. The research strategy is based on multicriteria analysis, and the selected techniques are based on the MCDA-C procedure, that is, the processes of structuring, evaluating and recommending improvements.

The research results provided: a data set external to the context that serves as theoretical support for the comparisons made; the structuring of 4 unique organisational performance assessment models carried out through the MCDA-C procedure; conceptual interpretation using the lens of the operations strategy in the cognitive maps of the assessment models, which identifies the operations strategy carried out; and comparison of the result models that show their uniqueness.

The comparison between the origins of knowledge is highlighted, and the demonstration of the content was proposed by the literature and by specialists to evaluate the performance in operations. This was then compared with the content constructed with credit union managers in structuring models based on the singularities of the respective contexts. The theory was compared to practice, and it was demonstrated how the content of the operations regarding the performance could be used in decision contexts.

The purpose of this paper is to propose a new approach to talent management that consists of averaging performance appraisal and assessment center ratings for in-depth identification of lawyers’ talents.

The approach’s adjustment was examined using a 61 senior-lawyer sample from a Portuguese law firm. Comparisons between assessment center and performance appraisal ratings were analyzed using paired-sample t-tests and a kernel density function, and predictive validity was assessed with Pearson correlations. Evidence of both a general performance factor and two additional factors was verified using principal component analysis. Varimax rotation was used to verify three broad factors with job profile’s three broad areas.

Results suggest support for the assessment center’s predictive validity. Its lower and more variable ratings overcome performance appraisal rating bias. Adjustment of the new approach to lawyers’ overall talent identification (the general factor) and each lawyer’s relative talents (three broad factors) was observed.

This study contributes to the body of knowledge regarding the substantive existence of a general performance factor, and adds to empirical research concerning talent management, which is lacking. However, generalizability requires broader samples and replication.

The approach is a methodology that informs career management, high-flyers’ identification, talent mapping, development, succession planning, team composition, and diversity analysis. For lawyers, objective feedback allows benchmarking talent and managing one’s career.

This study pioneers empirical research that develops methods for identifying talent in law firms, vital for firm sustainability.

The purpose of this paper is to compare two years of results for one state’s performance-based assessments for principal licensure Performance Assessment for Leaders (PAL). This includes the field trial (2014–2015) and first year of statewide implementation (2015–2016) when passing score requirements and fees were added. Survey results on candidates’ career aspirations provide concurrent validation.

Two years of PAL submissions (n=569 candidates) were scored by trained, certified scorers. Task and total score results were compared by year, preparation pathway and gender. Online feedback survey results on career aspirations for (n=146 candidates) were compared by year.

The results show that PAL assessments measure independent dimensions of leadership, differentiate candidates on leadership knowledge and skills, and confirm PAL’s internal validity. Implementation year scores were higher than field trial scores, and preparation program candidates scored better than non-program candidates did. Candidate career aspirations were stronger in the implementation year than during the field trial.

The study is limited to one state’s candidates, but findings are generalizable based on the wide range among candidates’ districts (demographically and economically).

The results are promising for the leadership preparation and assessment field, demonstrating the effectiveness of performance assessment for authentic evaluation of leadership candidates’ knowledge and skill and overall readiness for initial leadership work.

This is the first large scale performance assessment for aspiring leaders designed for state licensure decisions. It is being replicated in another state and shown promise for both formative and summative leadership assessment.

INTRODUCTION Performance appraisal and review, sometimes also referred to as merit rating, staff appraisal, or personnel assessment (although these terms are by no means synonymous), is a process in which “bosses” regularly evaluate and report on the performance, attainments, abilities, potential for future development and other qualities of their organisational subordinates.

The existing concept in the building rating scheme especially in developing countries was more focused on the environment, economic, social and culture. The new approach of the classroom condition index (CCI) assessment scheme has its uniqueness in environmental and social aspects because of high building performance in secondary school buildings. The requirements set by the Ministry of Education Malaysia include providing a conducive learning environment, especially for students who are considered as the main users of classrooms in school buildings. Currently, the school administration needs to manually record the condition of the classroom to increase its comfort level. The lack of a structured scheme for classroom assessment makes it difficult for school administration to focus on the overall classroom condition (physical environmental aspect) in the school building. The purpose of this study is to develop a framework for classroom conditions by proposing a CCI assessment scheme for a secondary school building in Malaysia.

Mixed methods were used to carry out the study. The first stage of this study concentrates on developing a system for CCI that relates to physical elements in the classroom. This is done by reviewing the literature on the classroom physical performance, as well as a comparison between several building rating systems locally and abroad. The structure of the proposed CCI scheme is grouped into four main themes, namely, space management quality (SMQ), building condition (BC), indoor environmental quality (IEQ) and teaching and learning quality (TLQ). In addition, there are 12 categories and 23 indicators listed under this theme. The second stage focuses on formulating assessment categories with their relevant performance indicators. This phase undergoes a validation process by conducting a survey (questionnaire) toward the classroom’s main users, which are students and teachers. This is to ensure the accuracy of classroom conditions in the school building. A semi-structured interview was also conducted among building experts. They are building surveyors, building engineers, building designers and building performance experts to support the main findings in the second stage. Relative importance (RI) index approach has been applied to show the indicators weighting and ranking are used as data collections method by using Statistical Package of Social Science software to examine the RI of each category and indicator, respectively.

The findings show that prominent RI and balanced weights are formed from these four main themes. They are SMQ (19.9%), BC (26.6%), IEQ (33.2%) and TLQ (20.3%). The outcome of this study will contribute to a detailed assessment scheme for CCI at the secondary school building. The contribution of the CCI Assessment Scheme is more comprehensive and holistic than the conventional assessment process for BCs. It focuses specifically on classroom space as it is the most important area to achieve a high level of comfort comparing to other spaces in the school building. This holistic approach encompasses all types of classrooms. The concept of one tool fits all is seen as no longer a relevant adaptation in this context. This proposed tool is to be used only for the classroom (as the name CCI implies) and it cannot be used for the other types of spaces, for instance, teacher room, library, meeting room, toilet, canteen and, etc. This is because different spaces represent different physical indicators to be classified. This, in turn, contributes to a conducive learning environment for students in the school.

This paper provides the current information, knowledge and findings related to the classroom physical indicators in developing the assessment scheme for the classroom environment. It will assist both technical and non-technical experts to clarify the current condition of classroom physical performance that ideally may affect the students’ learning environment. The novelty of CCI development is not only on the adopted method but it also includes the ideas on next generation model of rating system that ideally need specific indicators and weighting to be generated into an intelligent computerized system.

The purpose of this paper is to develop an assessment methodology that can be used to evaluate performance of small and medium enterprises (SMEs) in the manufacturing sector.

This area of the study focuses on the assessment of performance in manufacturing SMEs. The methodology contains qualitative and quantitative measures that can quantify the opportunities and benefits within SMEs, as well as identifying the performance gaps between the current performance of the company and world-class performance. This includes reviewing the literature relating to assessment methodology and collecting data by carrying out semi-structured interviews with staff at target SMEs.

The results show that the proposed assessment methodology is effective in identifying hidden opportunities and benefits in the manufacturing SMEs sector, establishing world-class performance of the companies and comparing this with current performance in order to identify gaps in performance in manufacturing SMEs.

This assessment can be used for monitoring and assessing SMEs performance. The developed methodology can be used by manufacturing SMEs as an assessment and benchmarking tool. It enables manufacturing SMEs to identify opportunities for improvement and determine the gaps in current performance; this will assist manufacturing SMEs in selecting an appropriate tool to improve their performance in order to achieve the company objectives.

This paper presents a successful and effective assessment methodology for manufacturing SMEs. It measures current performance which will provide a useful indicator to identify waste. It attempts to improve company performance and suggests how such activities could be organised and managed more effectively. Consequently it leads to a high potential for cost and time saving and quality improvement.