Search results

The purpose of this article is to analyze main principles, forms and approaches to education quality evaluation in the process of establishment, development and crucial changes in the state accreditation of educational institutions and study programmes in Russian higher education in the last 20 years.

The major research method used in the paper is the qualitative analysis of legal and statistical documents, research papers and accreditation practices, which impacted the development and transformation of accreditation forms in Russia.

The transformation process of state accreditation during the last 20 years was conditioned by the changes in the state education policy and socio-economic situation. In a short period, under the influence of internal and external factors, Russian higher education has experienced significant changes in the structure of higher education and quality assurance. This resulted in different approaches to accreditation: state and independent, mandatory and voluntary, national and international.

The research outcomes may be applicable in the countries with developing accreditation systems and comparable scope of education.

The study identifies the tendencies in the development of higher education and quality evaluation.

The paper systematizes the tendencies of development in quality assurance and distinguishes specific features and diversity of forms of the quality assurance in one of the largest systems of higher education.

The purpose of this paper is to facilitate a deeper understanding of the uses and users of performance measurement (PM) in the university context.

Empirical data were gathered from four universities. This approach allows for a multilevel and comparative analysis based on the neo-institutional theory. The results are discussed alongside interdisciplinary literature on the use of PM in the public sector.

PM practices at universities have become increasingly popular on institutional, organisational and individual levels. The results indicate that different types of PM are used in universities and that the extent, and scope of PM used by various actors differ. Universities often use PM in a ceremonial and symbolic manner, with the aim of legitimising themselves externally as research-oriented institutions. The use of PM depends on both, exogenous factors (such as isomorphic pressures) and endogenous factors related to the different responses of organisations and individual actors (university managers, and academics). However, the analysis at the internal level reveals different attitudes and some resistance to the use of such kinds of PM. In universities with a local focus, the use of PM for rational decision-making is generally loosely coupled with the reporting performance for external accountability purposes. Moreover, the internal use of PM can be also symbolic.

This paper focusses on four case studies that are currently undergoing changes. The comparative analysis is supported by the use of different data collection methods and several in-depth interviews with key university actors.

The authors assume that the use of PM depends on a number of exogenous and endogenous factors. PM uses and users are discussed in the specific context of the higher education system in Poland. The four business school cases facilitate a comparative analysis of the similarities and differences in terms of the uses and users of PM in the context of internationally and locally oriented universities.

During the evaluation of European Capital of Culture (ECoC) Aarhus 2017, the evaluation organisation rethinkIMPACTS 2017 formulated a set of “dilemmas” capturing the main challenges arising during the design of the ECoC evaluation. This functioned as a framework for the evaluation process. This paper aims to present and discuss the relevance of the “Evaluation Dilemmas Model” as subsequently applied to the Galway 2020 ECoC programme evaluation.

The paper takes an empirical approach including auto-ethnography and interview data to document and map the dilemmas involved in undertaking an evaluation in two different European cities. Evolved via a process of practice-based research, the article addresses the development of and the arguments for the dilemmas model and considers its potential for wider applicability in the evaluation of large-scale cultural projects.

The authors conclude that the “Evaluation Dilemmas Model” is a valuable heuristic for considering the endogenous and exogenous issues in cultural evaluation.

The model developed is useful for a wide range of cultural evaluation processes including – but not limited to – European Capitals of Culture.

What has not been addressed in the academic literature is the process of evaluating ECoCs; especially how evaluators often take part in an overall process that is not just about the evaluation but also planning and delivering a project that includes stakeholder management and the development of evaluation criteria, design and methods.

This study aims to investigate the organisational structure to exploit data analytics in the educational sector. The paper proposes three different organisational configurations, which describe the connections among educational actors in a national system. The ultimate goal is to provide insights about alternative organisational settings for the adoption of data analytics in education.

The paper is based on a participant observation approach applied in the Italian educational system. The study is based on four research projects that involved teachers, school principals and governmental organisations over the period 2017–2020.

As a result, the centralised, the decentralised and the network-based configurations are presented and discussed according to three organisational dimensions of analysis (organisational layers, roles and data management). The network-based configuration suggests the presence of a network educational data scientist that may represent a concrete solution to foster more efficient and effective use of educational data analytics.

The value of this study relies on its systemic approach to educational data analytics from an organisational perspective, which unfolds the roles of schools and central administration. The analysis of the alternative organisational configuration allows moving a step forward towards a structured, effective and efficient system for the use of data in the educational sector.

The purpose of this paper is to explore the adverse incentives at the front end of government-funded projects with concentrated benefits and no liabilities for the privileged groups. In particular, the author discusses the risk of perverse incentives of the types typically found in the development aid sector that results in counterproductive outcomes.

The paper uses a simple conceptual framework based on agency theory. A qualitative, case-based approach with purposive sampling was chosen for the empirical part of the study. Eight Norwegian projects were selected because incentive problems were to be expected, and one development aid project served as a reference case.

The paper finds that low strategic project success corresponded well with the terms of financing. There were clear indications of agency problems, in three cases to the extent that the incentives turned perverse. The paper concludes with a discussion of relevant measures to prevent the emergence of perverse incentives.

The paper contributes to an improved understanding of the incentives related to public project initiation and selection, which is an under-researched topic and generally not included in formal project governance schemes. The research should therefore be useful to scholars as well as practitioners within the field of project governance.

The purpose of this paper is to examine how the Japanese and Taiwanese national quality assurance (QA) agencies, National Institution for Academic Degrees and Quality Enhancement (NIAD-QE) and Higher Education Evaluation and Accreditation Council of Taiwan (HEEACT), transform their respective frameworks in response to social demands, and analyze and compare the respective approaches for the key concepts of autonomy, accountability, improvement and transparency.

Using a qualitative document analysis approach, this paper initially examines the higher education system, major policies and QA developments, after which the methods associated with the QA restructuring transformations are outlined in terms of motivations, expectations and challenges. Finally, the NIAD-QE and HEEACT evaluation policies and frameworks are compared to assess how each has prepared to respond to emerging challenges.

During the QA framework restructuring, both the NIAD-QE and HEEACT struggled to achieve autonomy, accountability, improvements and transparency. While the new internal Japanese QA policy is assured through the external QA, the Taiwanese internal QA, which has a self-accreditation policy, is internally embedded with university autonomy emphasized. The QA policies in both the NIAD-QE and HEEACT have moved from general compliance to overall improvement, and both emphasize that accountability should be achieved through improvements. Finally, both agencies sought transparency through the disclosure of the QA process and/or results to the public and the enhancement of public communication.

This study gives valuable insights into the QA framework in Asian higher education institutions and how QA has been transformed to respond to social needs.

The study aims to determine whether audited organizations experience differences between external audits and official controls.

A survey among 100 organic food producers was conducted to explore differences regarding the usability of external audits and official controls. The survey was conducted in 2020 using the computer-assisted telephone interview (CATI) method supplemented by the computer-assisted web interview (CAWI) method. Organizations processing organic farming products in Poland were chosen for the study.

Three primary benefits associated with external audits and official controls were identified, i.e. (1) enabling and initiating activities related to the improvement of the organization, (2) improving the financial performance of the organization and (3) enhancing credibility. For most organizations, the assessment of these features was at the same level for both external audits and official control. However, if these assessments differed, commercial audits were assessed at a higher level than official controls.

The study is limited to only one specific type of manufacturing organization and one European country.

The literature review shows some conceptual differences between audits and official controls, but the results of this study show that the business environment does not perceive these differences as significant. Thus, the value of the study is reflected in the conclusion that both external audits and official controls are considered useful and credible approaches to monitoring the quality within the organization, which allows us to state that external evaluation is generally seen as an opportunity to improve the performance of the organization.

Enabling employee creativity and channeling the creativity of employees toward process and product innovations is a starting point of value creation processes and strategy maps. The dominant view in early creativity research seemed to be that creativity and control are inconsistent. More recently, a number of studies have come to acknowledge that performance evaluations (and rewards linked to such evaluations) may well have positive effects on creativity. This paper aims to review existing results on the effects of performance evaluations on creativity from the perspectives of different research streams.

This paper analyzes a stream of research in social psychology which has promoted the notion of an overall negative effect of performance evaluations on creativity. The (reinterpreted) results from this research stream are contrasted with findings from the behaviorist perspective and with research in management accounting.

The review of the different research traditions in the analysis of the effects of performance evaluations on creativity indicates that the seemingly contradictory empirical results can be explained by the different settings used and by the different ways how performance evaluations and linked rewards are conceptualized.

The paper clarifies that, in contrast to common beliefs, performance evaluations and linked incentives do not kill creativity in general. Performance evaluations and incentives can support creativity and innovation if they are transparent about what kind of creativity is desired and how such creativity is measured and rewarded. Moreover, incentives can effectively support behaviors that are known to be important within creativity and innovation processes.

The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to shed light on how external pressures related to measurement of research performance are translated into organisational and individual academic responses within the university and the extent to which these responses are related specifically to the operational features of performance measurement systems (PMS).

The study is based on a case study conducted in an Italian public university and based on interviews with a cross-disciplinary sample of faculty members.

The study provides insights into how linking financial incentives and career progression to research performance metrics at the system and organisational levels may have important reorientation effects on individual behaviours and epistemic consequences for the academic work.

The study is based on interviews, so one limitation is related to the risk of researcher and interviewee personal bias. Moreover, this study is focused on one single case of a specific university setting, which cannot be fully representative of the experiences of others.

The study contributes to the literature on management accounting by exploring the factors that might explain why the unintended effects of PMS on academics’ behaviour reported by several studies might occur. From a practitioner’s point of view, it shows features of PMS that may produce unintended effects on academic activities. It also highlights the need to rethink PMS for the evaluation of university performance through the involvement of different stakeholders.