Search results

During the evaluation of European Capital of Culture (ECoC) Aarhus 2017, the evaluation organisation rethinkIMPACTS 2017 formulated a set of “dilemmas” capturing the main challenges arising during the design of the ECoC evaluation. This functioned as a framework for the evaluation process. This paper aims to present and discuss the relevance of the “Evaluation Dilemmas Model” as subsequently applied to the Galway 2020 ECoC programme evaluation.

The paper takes an empirical approach including auto-ethnography and interview data to document and map the dilemmas involved in undertaking an evaluation in two different European cities. Evolved via a process of practice-based research, the article addresses the development of and the arguments for the dilemmas model and considers its potential for wider applicability in the evaluation of large-scale cultural projects.

The authors conclude that the “Evaluation Dilemmas Model” is a valuable heuristic for considering the endogenous and exogenous issues in cultural evaluation.

The model developed is useful for a wide range of cultural evaluation processes including – but not limited to – European Capitals of Culture.

What has not been addressed in the academic literature is the process of evaluating ECoCs; especially how evaluators often take part in an overall process that is not just about the evaluation but also planning and delivering a project that includes stakeholder management and the development of evaluation criteria, design and methods.

The authors compare perspectives on external evaluation of health service provision between Norway and the USA. External inspection and accreditation are examples of internationally wide-spread external evaluation methods used to assess the quality of care given to patients. Different countries have different national policy strategies and arrangements set up to do these evaluations. Although there is growing attention to the impact and effects on quality and safety from external evaluation, there is still a gap in knowledge to how structures and processes influence these outcomes. Accordingly, the purpose of this article is to describe the structures and processes in external evaluation designed to promote quality improvement in Norway and the USA with attention to comparison of enablers and barriers in external evaluation systems.

Data collection consisted of documentary evidence retrieved from governmental policies, and reviews of the Joint Commission (the US), international guidelines, recommendations and reports from the International Society for Quality in Health Care, and the World Health Organization, and policies and regulations related to Norwegian governmental bodies such as the Ministry of Health and Care Services, the Norwegian Directorate of Health, and the Norwegian Board of Health Supervision . Data were analyzed inspired by a deductive, direct content analytical framework.

The authors found that both accreditation and inspection are strategies put in place to ensure that healthcare providers have adequate quality systems as well as contributing to the wider risk and safety enhancing management and implementation processes in the organizations subjected to evaluation. The US and the Norwegian external regulatory landscapes are complex and include several policymaking and governing institutions. The Norwegian regulatory framework for inspection has replaced an individual blame logic with a model which “blames” the system for inadequate quality and patient harm. This contrasts with the US accreditation system, which focuses on accreditation visits. Although findings indicate an ongoing turning point in accreditation, findings also demonstrate that involving patients and next of kin directly in adverse event inspections is a bigger part of a change in external inspection culture and methods than in processes of accreditation.

The message of this paper is important for policymakers, and bodies of inspection and accreditation because knowledge retrieved from the comparative document study may contribute to better understanding of the implications from the different system designs and in turn contribute to improving external evaluations.

Although there is a growing attention to the impact and effects on quality and safety from external evaluation, the implications of different regulatory strategies and arrangements for evaluation on quality and safety remain unclear.

Course evaluations are formative and are used to evaluate learnings of the students for a course. Anomalies in the evaluation process can lead to a faulty educational outcome. Learning analytics and educational data mining provide a set of techniques that can be conveniently applied to extensive data collected as part of the evaluation process to ensure remedial actions. This study aims to conduct an experimental research to detect anomalies in the evaluation methods.

Experimental research is conducted with scientific approach and design. The researchers categorized anomaly into three categories, namely, an anomaly in criteria assessment, subject anomaly and anomaly in subject marks allocation. The different anomaly detection algorithms are used to educate data through the software R, and the results are summarized in the tables.

The data points occurring in all algorithms are finally detected as an anomaly. The anomaly identifies the data points that deviate from the data set’s normal behavior. The subject which is consistently identified as anomalous by the different techniques is marked as an anomaly in evaluation. After identification, one can drill down to more details into the title of anomalies in the evaluation criteria.

This paper proposes an analytical model for the course evaluation process and demonstrates the use of actionable analytics to detect anomalies in the evaluation process.

The purpose of this study is to propose a framework for the convergence of maturity model and education and evaluation in accounting.

The present research was conducted in two phases. In the first phase, to determine the indicators of convergence of the maturity model and education and evaluation in accounting, a Meta-Synthesis method was used. The conceptual model includes two dimensions of “Teaching and learning processes” and “Evaluation methods"; five levels of initial, repeatable, defined, managed and optimized; and a total number of 35 indicators. In the second phase, a questionnaire was developed, and academics as accounting faculty members in Iranian public universities were employed to fill out the questionnaire electronically and present a final framework. Having received the questionnaires, 66 questionnaires were analyzed statistically.

The results showed that the two dimensions of “Teaching and learning processes” and “Evaluation methods” considering initial, repeatable, defined, managed and optimized levels include 35 indicators, which form a framework for the convergence of maturity model and education and evaluation in accounting. The results show that both dimensions have positive and significant regression path coefficients in the convergence model. Moreover, the dimension of teaching and learning processes has the highest regression path coefficient indicating a greater impact on the convergence model. Besides, all five levels have positive and significant regression path coefficients with dimensions. Finally, in this study, all indicators were prioritized according to five levels.

Due to the success of maturity models and the urgent developments that require transformative improvements in accounting education, maturity models can respond to the challenges associated with education and learning in accounting. Thus, conceiving an image of the convergence of maturity model, education and evaluation in accounting seems imperative which has been scarcely investigated previously.

Scholars have pointed out the need for improvement and refinement in public management research, also depending on the role of public administration for sustainable development. Because government organizations employ a substantial portion of the workforce, management practices in the public sector are critical areas for designing, implementing and delivering policies that can achieve the goals set forth in the 2030 Agenda for Sustainable Development. For these purposes, and in implementation of the Next Generation EU (NGEU) programme, Italy recently launched an ambitious National Recovery and Resilience Plan (NRRP) which includes, among other things, upskilling goals for staff employed, following the modernization process that has involved the Italian public sector in the last decades, with the Decree n. 150/2009. Aiming both to understand the extent of the application of the reform and to answer some basic questions (why, what and how) concerning Individual Performance Appraisal Systems (IPAS), we conducted a content analysis on the 220 documents already produced by the Italian Ministries. The study has been conducted in two different steps of the reform process and provides solid evidence of the reforms' effects on designing and implementing individual performance systems. The analyzed documents reveal no longer-term vision in implementing the IPAS that involves some critical performance management utilities such as training, development, fair pay and deployment of employees, raising new questions about a sustainable approach to the individual performance management process even in public organizations.

This paper adds to the ongoing debate on judgements, opportunity evaluation and founder identity theory and shows that founders vary in their prioritisation and combination of judgement criteria, linked to their respective social founder identity. It further reveals how this variation among founder identity types shapes their perception of distinct entrepreneurial opportunities and the forming of first-person opportunity beliefs.

This study uses a qualitative approach by presenting three business scenarios to a sample of 34 first-time founders. It adopts a first-person perspective on their cognitive processes during the evaluation of entrepreneurial opportunities using verbal protocol and content analysis techniques.

The theorised model highlights the use of similar categories of judgement criteria by individual founders during opportunity evaluation that followed two distinct stages, namely search and validation. Yet, founders individualised their judgement process through the prioritisation of different judgement criteria.

The authors provide new insights into how individuals individuate entrepreneurial opportunities through the choice of different judgement criteria that enable them to develop opportunity confidence during opportunity evaluation. The study also shows that first-time founders depict variations in their cognitive frames that are based on their social identity types as they assess opportunity-related information and elicit variations in reciprocal relationships emerging between emotion and cognition. Exposing these subjective cognitive evaluative processes provides theoretical and practical implications that are discussed as well.

This paper aims to define a hierarchical and multi-criteria framework based on pillars of the Modernization of Higher Education to evaluate European Accounting Doctoral Programmes (EADE-Model).

The authors applied a quali-quantitative methodology based on the analytic hierarchy process and the survey approach. The authors conducted an extensive literature and regulation review to identify the dimensions affecting the quality of Doctoral Programmes, choosing accounting as the relevant and pivotal field. The authors also used the survey to select the most critical quality dimensions and derive their weight to build EADE Model. The validity of the proposed model has been tested through the application to the Italian scenario.

The findings provide a critical extension of accounting ranking studies constructing a multi-criteria, hierarchical and updated evaluation model recognizing the role of doctoral training in the knowledge-based society. The results shed new light on weak areas apt to be improved and propose potential amendments to enhance the quality standard of ADE.

Theoretical and practical implications of this paper are directed to academics, policymakers and PhD programmes administrators.

The research is original in drafting a hierarchical multi-criteria framework for evaluating ADE in the Higher Education System. This model may be extended to other fields.

The purpose of this co-produced research project was to conduct interviews with people working in, volunteering with and accessing Canadian recovery colleges (RCs) to explore their perspectives on what an evaluation strategy for RCs could look like.

This study used a participatory action research approach and involved semistructured interviews with 29 people involved with RCs across Canada.

In this paper, the authors share insights from participants about the purposes of RC evaluation; key elements of evaluation; and the most applicable and effective approaches to evaluation. Participants indicated that RC evaluations should use a personalized, humanistic and accessible approach. The findings suggest that evaluations can serve multiple purposes and have the potential to support both organizational and personal-recovery goals if they are developed with meaningful input from people who access and work in RCs.

The findings can be used to guide evaluations in which aspects that are most important to those involved in RCs could inform choices, decisions, priorities, developments and adaptations in RC evaluation processes and, ultimately, in programming.

A recent scoping review revealed that although coproduction is a central feature of the RC model, coproduction principles are rarely acknowledged in descriptions of how RC evaluation strategies are developed. Exploring coproduction processes in all aspects of the RC model, including evaluation, can further the mission of RCs, which is to create spaces where people can come together and engage in mutual capacity-building and collaboration.

This study aims to conceptualize, rethink and systematize methods used for measurement and evaluation (M&E) corporate communication.

The reflection is based on 462 key English-language books and papers devoted to M&E in the fields of corporate communication and public relations from the 1970th to 2023. Keywords in the titles and abstracts found the necessary materials. A critical analysis of the central concepts, models and methods described in the literature was conducted. As a result, a new model that unifies and structures the M&E toolkit is proposed for discussion.

Despite the significant contribution to developing a wide range of M&E models, they are still not perfect and universal. In addition, this system of approaches is continuously self-evolving and changing under the influence of digital innovations, so it requires steady rethinking and updating. On the other hand, most previous studies focused on communication management processes, losing focus on communication aspects. This led to the need for an alternative view based on proven theories to fill this gap. The proposed model combines quantitative and qualitative M&E methods for the five main components of corporate communication (communicator, audience, content, channels and result), covering a wide range of tools, from statistical and sociological research to big data analysis and neuro research.

This work contributes to developing the M&E theory of corporate communication, systematizing existing methods and opening new research perspectives. From a practical point of view, companies can use the presented approach for a more accurate and objective internal evaluation of the main components of corporate communication.