Rational and symbolic uses of performance measurement: Experiences from Polish universities

Dorota Dobija (Department of Accounting, Kozminski University, Warsaw, Poland)
Anna Maria Górska (Department of Marketing, Kozminski University, Warsaw, Poland)
Giuseppe Grossi (School of Health and Society, Kristianstad University, Kristianstad, Sweden)
Wojciech Strzelczyk (Department of Accounting, Kozminski University, Warsaw, Poland)

Accounting, Auditing & Accountability Journal

ISSN: 0951-3574

Article publication date: 2 April 2019

Issue publication date: 14 June 2019

4802

Abstract

Purpose

The purpose of this paper is to facilitate a deeper understanding of the uses and users of performance measurement (PM) in the university context.

Design/methodology/approach

Empirical data were gathered from four universities. This approach allows for a multilevel and comparative analysis based on the neo-institutional theory. The results are discussed alongside interdisciplinary literature on the use of PM in the public sector.

Findings

PM practices at universities have become increasingly popular on institutional, organisational and individual levels. The results indicate that different types of PM are used in universities and that the extent, and scope of PM used by various actors differ. Universities often use PM in a ceremonial and symbolic manner, with the aim of legitimising themselves externally as research-oriented institutions. The use of PM depends on both, exogenous factors (such as isomorphic pressures) and endogenous factors related to the different responses of organisations and individual actors (university managers, and academics). However, the analysis at the internal level reveals different attitudes and some resistance to the use of such kinds of PM. In universities with a local focus, the use of PM for rational decision-making is generally loosely coupled with the reporting performance for external accountability purposes. Moreover, the internal use of PM can be also symbolic.

Research limitations/implications

This paper focusses on four case studies that are currently undergoing changes. The comparative analysis is supported by the use of different data collection methods and several in-depth interviews with key university actors.

Originality/value

The authors assume that the use of PM depends on a number of exogenous and endogenous factors. PM uses and users are discussed in the specific context of the higher education system in Poland. The four business school cases facilitate a comparative analysis of the similarities and differences in terms of the uses and users of PM in the context of internationally and locally oriented universities.

Keywords

Citation

Dobija, D., Górska, A.M., Grossi, G. and Strzelczyk, W. (2019), "Rational and symbolic uses of performance measurement: Experiences from Polish universities", Accounting, Auditing & Accountability Journal, Vol. 32 No. 3, pp. 750-781. https://doi.org/10.1108/AAAJ-08-2017-3106

Publisher

:

Emerald Publishing Limited

Copyright © 2019, Dorota Dobija, Anna Maria Górska, Giuseppe Grossi and Wojciech Strzelczyk

License

Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) licence. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this licence may be seen at http://creativecommons.org/licences/by/4.0/legalcode


1. Introduction

Universities commonly measure and report their performance. However, the methodology of performance measurement (PM) that is used to evaluate university faculty members and the application of PM to allocate resources and increase transparency, credibility, and image, can vary considerably. Traditionally, PM practices have played a developmental role in helping academic faculty enhance their future performance. Nonetheless, there has been a shift towards a more quantitative and objective approach in which the evaluation is based on a great deal of quantitative information collected from past performance data (Guthrie and Neumann, 2007; Kallio and Kallio, 2014; Pettersen, 2015; ter Bogt and Scapens, 2012). This change in performance appraisal has often been associated with a rise in new public management and a growth in managerialism in the application of private sector methods within the public sector. Past accounting research has documented that PM practices have changed and have become more sophisticated with the development of different technologies (Agyemang and Broadbent, 2015; Parker, 2011) (e.g. rankings, ratings, journal lists, performance indicators and balanced scorecards).

Many scholars and practitioners remain sceptical of the usefulness and relevance of PM for decision-making purposes. This is probably why the use of PM has, thus far, not attracted much attention, despite calls for more research on the topic (Moynihan and Pandey, 2010). Moreover, past research has focussed on the uses and users of PM within central and local governments (Ammons and Rivenbark, 2008; Hammerschmid et al., 2013; Kroll, 2015). Few accounting studies have examined these issues at universities (Agyemang and Broadbent, 2015; Boitier and Rivière, 2013; Broadbent et al., 2010; Pop-Vasileva et al., 2011).

This paper highlights the uses and users of PM in the university context by answering three research questions:

RQ1.

What measures are used?

RQ2.

Who uses PM?

RQ3.

How is PM used?

This paper makes three important contributions to the literature. First, in a broader sense, the paper contributes to the literature on public management and accounting. Although a number of empirical studies on the use of PM in the public sector have risen in recently, overall, the number is relatively small when compared to the general literature on PM. Moreover, past studies have focussed on the external use of PM for external accountability purposes by public agencies and regulatory authorities, including politicians and the consequences of the introduction of performance-driven judgemental quantitative performance systems (Agyemang and Broadbent, 2015; Broadbent et al., 2010; Coy and Pratt, 1998; Kallio and Kallio, 2014; Osterloh, 2010). There has been some discussion regarding the external requirements of PM systems in the context of institutions of higher education (Agyemang and Broadbent, 2015; Boitier and Rivière, 2013; Broadbent et al., 2010). To supplement this discussion, this study offers an insight into how internal actors (e.g. university managers, administrators and academics) use PM in response to exogenous pressures (coming from externally imposed regulations), as well as from endogenous pressures (based on university responses or autonomous initiatives to assess their performance). Thus, the paper contributes to the growing academic debate on the uses and users of PM in the university context.

Second, this study focusses on the uses and users of PM in universities. The paper highlights that in the higher education sector, PM is conducted for external and internal purposes. Accounting and management scholars have pointed out the different motivations for the use of PM and have distinguished between the rational and symbolic uses of PM (Agostino and Arnaboldi, 2017; Mouritsen, 1994; Tucker and Parker, 2015). The external use of PM is an attempt to increase accountability, and thus, has more symbolic characteristics that is intended to be used for operational and strategic rational decision-making. This paper documents both, the symbolic and the rational uses of PM, and highlights, when it is used internally, the fact that PM can not only be used for the rational co-ordination of university operations and strategies, but that it can also be used at the symbolic level for the legitimisation purposes of individuals (e.g. academics and university managers) and institutions (e.g. universities and departments).

Third, most studies on the implementation of PM systems have been conducted in the UK, Australia, New Zealand and Western Europe (Agyemang and Broadbent, 2015; Boitier and Rivière, 2013; Broadbent et al., 2010; Coy and Pratt, 1998; Modell, 2003; Narayan et al., 2017; Pop-Vasileva et al., 2011). The current study will add to the growing international list of empirical studies on PM, in general, and the use of PM, in particular, by studying four Polish universities. These universities all aspire to be recognised on the international academic stage. These institutional settings will provide some additional insight into who uses PM, as well as how it is used.

This research is based on four Polish business school case studies, where two of the schools are public universities and the other two are private universities. The empirical evidence stems from an analysis of the performance documentation and from interviewing academics and actors involved in the faculty management process. The analysis is explorative and interpretive in nature. We draw from the stream of literature related to the motivations of PM use, as well as the neo-institutional theory, to explain the positive and critical issues associated with the use of PM in the university context (Cai and Mehari, 2015; Ramirez, 2006).

The findings illustrate diverging trends towards using PM, at the individual and organisational levels, in the four universities under investigation. Different exogenous pressures have grown similar over time. This is mainly due to the need to comply with external formal requirements emanating from the regulations and expectations set by various accreditation agencies, at the national and international levels. For exogenous pressures to bring about fundamental transformation, an endogenous evolution should prepare the groundwork (Greenwood and Hinings, 1996). A certain degree of receptivity to change (Lapsley and Pettigrew, 1994) is necessary for universities to successfully modify and use their new PM systems. Internally, PM is used at the organisational level (e.g. university or department) by university managers, for ceremonial and symbolic reasons, in an attempt to legitimise the organisation towards external stakeholders. PM is also used by university managers for decision-making purposes (i.e. allocation of resources and incentives systems). In addition, PM is used by individual academics to celebrate academic achievements. It is often a part of an individual’s strategy to develop a personal brand (image) and gain legitimacy and credibility as a researcher.

This paper is divided into five sections. Section 2 presents the literature review and the theoretical framework. Section 3 presents the research data, methods and context. Section 4 presents the results. The discussions and conclusions as well as recommendations for future research are presented in the last section.

2. Theorising the PM

Over recent decades, with respect to PM use research, we have now accumulated a wealth of knowledge in a diverse range of contextual settings. A number of theories and analytical approaches can be utilised to interpret the collected research material on the use of PM in public sector organisations, and more specifically, in universities.

2.1 The rational and institutional views on PM in public sector organisations

The classical perspective of the role of accounting in an organisation is a view of accounting within the paradigm of rational choice. The rationality associated with accounting tools and methods “can be seen as an important mechanism through which accounting technologies symbolise and instrumentalise a process of rationalisation of social practices” (Giddens, 1971; Holten and Turner, 1989; Mouritsen 1994). Powell (1991) argues that organisations are truly concerned with task performance and that the difference between formal structure (appearance) and actual operations (reality) is sometimes small enough. In the same vein, accounting changes introduced by new accounting and PM tools can provide relevant and useful information for decision makers (Abernethy and Bouwens, 2005; Moll and Hoque, 2011; Mouritsen, 1994; Odzil and Hoque, 2017; Otley, 2003, 2016). According to such a perspective, the focus on efficiency and performance, in general, requires that organisational activities be monitored with the use of new accounting and PM systems. According to Ansari and Euske (1987, p. 552), accounting information is used as a tool in auditing choices between alternatives defined with present goals, and classified as having a technical rational focus. Rationality is intended as a goal-means consideration in support of a decision (Baxter and Chua, 2003, p. 112).

In contrast, many accounting scholars have highlighted the limitations of the classical Weberian rational choice approach and suggest that accounting, in general, and PM, in particular, may have many complex roles in organisations and society (Burchell et al., 1980). It has also been established that PM tools are adopted to meet organisational needs for institutional, social and political legitimacy (Brignall and Modell, 2000; Modell, 2001; Tucker and Parker, 2015). In general, Mouritsen (1994) proposes that accounting systems contribute to the rational co-ordination of activities, but not always. PM systems often have unintended consequences that “abound partly because accounting operates in complex institutional settings where the location and the context of social interaction is important for explaining and understanding it” (Mouritsen, 1994, p. 196).

The most widely used theory, to date, to understand PM practices and changes better in those practices, is neo-institutionalism. The study of institutions crosses the topics of sociology, politics, economics, and organisational theory, while the core assumption within the study is that organisations are rooted within the broader institutional context (DiMaggio and Powell, 1991). Therefore, organisational practices are either a reflection of, or a response to, rules and structures that are built into a larger environment (Paauwe and Boselie, 2003, cited by Najeeb, 2013, 2014). This environment acts as a source of behaviours, norms, and incentives, but also, from another perspective, the sanctions and limitations of organisational activities. Thus, the organisation does not determine its behaviours on its own, based on autonomous decision-making as a response to problems. Instead, organisations “tend to pattern their strategies on models and procedures that are widely recognised, accredited, and thus ‘institutionalised’ in the societal environment or organisational field” (Schriewer, 2009, p. 33) to increase their chances of survival.

The neo-institutional theory views accounting practices as one of a larger set of features that can legitimise organisations through the construction of an appearance of rationality and efficiency. Ceremonial and symbolic compliance with legitimate norms may have little impact, because a formal organisational structure is decoupled from the actual organisational process (Carruthers, 1995).

PM is often adopted in the public sector to satisfy organisational needs for institutional, social and political legitimacy. These needs can become incoherent with rational motivations (Tucker and Parker, 2015). Several scholars have pointed out that accounting reforms are more rhetorical, and are often symbolic window-dressing, rather than the production of new rational forms of institutional change (Agostino and Arnaboldi, 2017; Mimba et al., 2013; Modell, 2001). Czarniawska-Joerges and Jacobsson (1989), based on examples taken by the Swedish public sector, depicted budgeting as a symbolic or ceremonial performance tool, rather than a decision-making process. They also stated that it is a means of conversation, rather than a means of control, and an expression of values, rather than an instrument for action (Czarniawska-Joerges and Jacobsson, 1989). Past studies show that both, external and internal contexts play a crucial role in explaining how and why the adoption of a new PM tool may (or may not) be translated into practice, assume different features and become institutionalised. ter Bogt and van Helden (2000) have also illustrated that mandatory reform adoption does not necessarily bring about expected results, thus undermining the relevance of studying the institutionalisation of reforms within an organisation (Harun et al., 2012).

In a globalised world, which has been strongly affected by economic and financial crises and has shared the need for reform, exogenous pressures have motivated organisations to adopt a similar reform package through isomorphic behaviours, that is, each organisation tends to resemble the others for the sake of increasing their legitimacy and conforming to socially accepted rules and practices (DiMaggio and Powell, 1983). Hence, the agenda of many universities worldwide converged towards PM systems (Pollitt, 2002). The idea of convergence comes from the institutional theory that has emphasised the process of isomorphism, whereby organisations adopt similar procedures to gain legitimacy as a result of coercive, mimetic and normative pressures (DiMaggio and Powell, 1983).

Mimetic processes are a result of organisations’ responses to uncertainty. Organisations copy successful organisations, in order to gain legitimacy (DiMaggio and Powell, 1983). Specifically, in the higher education context with an increasing level of competition and internationalisation that has shaped the field over the last few decades, universities have tried to model themselves on others operating in similar contexts through mimetic processes. In mimetic isomorphism higher education institution seek accreditations due to competitive pressures rather than to improve their own efficiency.

Further, coercive and normative pressures for meeting the expectations of international organisations, fora, and professional networks, and to respond to economic demands and exogenous pressures (Van Gestel and Teelken, 2006), have motivated universities to try to adopt a textbook model of PM.

Normative isomorphism refers to the relationship between the regulations and employees’ background. This type of isomorphism is associated with professionalisation (Paauwe and Boselie, 2003). Within the higher education context, normative isomorphism considers the role of regulatory bodies and professional organisations as accreditation agencies through their formal requirements, standards and international orientation.

Coercive isomorphism, on the other hand, refers to the influence of the political and governmental regulations on the organisations. It refers to cases where universities are likely to implement changes within their policies in order to adjust to the requirements set by the government, thus, due to coercive pressures (Najeeb, 2013).

The neo-institutional theory is also useful in explaining the role of PM tools in ensuring that internal actors accept an organisation (Grossi et al., 2016; Hoque, 2005). PM tools cannot be forced top-down. Instead, they need to be accepted at the lower levels of the organisations. Employees need to have the potential to impact the performance that is measured (Bouckaert, 1993). At the same time, achieving high legitimacy by internal actors may positively influence the implementation and use of PM tools (Moll and Hoque, 2011; Van Dooren et al., 2010). Such decoupling strategies could be employed by universities to defend their research autonomy (Narayan et al., 2017).

2.2 PM and management in universities

PM has been a relevant issue for public organisations from different areas, including higher education, not only because new public management has brought a stronger focus on output and outcome-oriented performance systems, but also because competitiveness has arisen within these organisations. Based on new public management-doctrines, PM practices arise as a way to “reinvent the government” (Osborne and Gaebler, 1993) and improve efficiency and effectiveness in public sector organisations (Hood, 1995). Accordingly, PM has been considered the main pillar of public management reforms in recent years (Almquist et al., 2013; Johnsen, 2005; Van Helden and Reichard, 2013; Walker et al., 2011). There is a growing critical view among public management and accounting scholars, based on the assumption that some PMs are designed for private sector organisations and are not always suitable for the specific needs of public sector organisations (Broadbent and Laughlin, 1998; Broadbent et al., 2001; Lapsley, 1999; ter Bogt and van Helden, 2000). Public sector organisations provide a variety of activities and set multiple goals to address different basic needs (Ferlie et al., 1996). Therefore, PM will require the consideration of both, quantitative and qualitative profiles, as well as different dimensions within those profiles.

A university is a very interesting context to study. During the past few decades, universities have implemented several changes at the national level that have had several effects at the organisational and individual levels. Since the performance of universities is frequently directly linked to the funds allocated to them, many universities spend considerable resources on the development of specific tools, allowing them to measure and communicate the performance of faculty in terms of research and teaching outputs (Agyemang and Broadbent, 2015; Boitier and Rivière, 2013). As in the case of other public organisations, management control systems enable universities to track how they are performing. Collecting and processing performance data enables organisations to set objectives and work towards meeting those objectives (Broadbent and Laughlin, 2009; Chenhall, 2003; Chenhall et al., 2010; Ferreira and Otley, 2009; Moynihan and Landuyt, 2009).

Control over research activity in universities is primarily based on the new public management approaches of PMM. Osterloh (2010) emphasises that output control relates to the use of output performance indicators (e.g. citations, the number of articles published in peer-reviewed journals and the number of PhDs completed) as a proxy for the output of researchers. The use of such output metrics makes it easier for external stakeholders to understand the PM better (Agyemang and Broadbent, 2015). From the internal stakeholders’ perspective, management-by-results is based on quantitative, rather than qualitative, measures. This management style has negative effects on the motivation to engage in creative, knowledge-intensive work (Kallio and Kallio, 2014).

ter Bogt and Scapens (2012) found that, in the case of Dutch and British universities, the use of judgemental quantitative systems has negative effects on teachers and scholars. This is because judgemental quantitative systems cause uncertainty and anxiety. As a consequence, they may also inhibit creativity and innovation in teaching, thus, limiting potential contributions to the world outside the university. Nevertheless, PM systems seem to remain a dominant force in the public sector, despite their unintended and perverse effects (Van Dooren and Thijs, 2010). When the quantity is valorised, potential perverse outcomes include the “publication game”, in which “the rational response is to produce multiple publications that are small variations on a theme” (Lewis, 2014, p. 424).

The universities’ PM systems are largely shaped by the needs of various external and internal stakeholders (Agyemang and Broadbent, 2015; Elliott and Goh, 2013). Guthrie and Neumann (2007) notice that the establishment of a performance-driven system for higher education is determined by linking the governmental funding of universities with the assessment of the results. Hence, it is directed towards improving the quality of services provided by universities (i.e. in the field of teaching and scientific research).

Greater interest in reliable information on a university’s performance, on the part of public institutions awarding funds for scientific research, stems from the reorientation of government financing of universities. The change in financing especially applies to public universities, which have undergone a shift from being fully funded to partially subsidised (Guthrie and Neumann, 2007). In this way, universities become more open to the market and transform from being academically driven to market driven.

PM is frequently used to create university and journal rankings (Adler and Harzing, 2008; Brooks, 2005; Dill and Soo, 2005; Agyemang and Broadbent, 2015). Research journal rankings indicate the detrimental and dysfunctional impacts of their use in managing research (Macdonald and Kam, 2007, 2009, 2011; Mingers and Willmott, 2013; Parker et al., 1998; Tourish and Willmott, 2015; Willmott, 1995, 2011). Lukka (2010) also points to the fact that the top international journals limit the scope of research by favouring research methods and imposing a narrow subject scope. Despite much criticism, journal rankings are used to manage the performance of academics for promotion and tenure decisions (Agyemang and Broadbent, 2015), but also to reward researchers for their achievements and motivate individuals to reach the desired levels of performance (Ferreira and Otley, 2009; Ryazanova and McNamara, 2016; Townley, 1997).

PM use is essential for improving the quality of teaching (Ammons and Rivenbark, 2008). However, most studies focus on measuring students’ satisfaction, rather than the quality of the teaching (Bedggood and Pollard, 1999; Bedggood and Donovan, 2011; Craig, 1995; Harnash-Glezer and Meyer, 1991; Kleiner, 1989; Lutz and Field, 1998; Sohail and Saeed, 2003). To date, studies in this area demonstrate evidence of such a claim (e.g. high evaluations of chosen tutors may be due to their popularity Ramsden, 1990, expressiveness Ware and Williams, 1980 or lower student requirements Brookfield and Preskill, 1999). Despite the criticism associated with this type of measurement, the results of the analysis are used in the process of university management. They constitute a key source of information while making decisions (e.g. study programmes, scope of the presented material and personnel changes) (Bedggood and Donovan, 2011). Universities also monitor student satisfaction and analyse the professional lives of graduates and their satisfaction with studies (Yorke and Longden, 2004).

The implementation of PM in the university context could easily lead to protests and perverse outcomes. Accordingly, the design of PM systems, without considering the specific characteristics of the university context or without defining the main stakeholders, and without dialogue about legitimate performance indicators, could generate a loose coupling between daily work and formal PM systems, and thus, potentially cause considerable harm for the university community. The success of the implementation phase is strongly affected by the capacity of the organisation to engage all stakeholders, employees and managers. Therefore, a good mix of bottom-up and top-down processes need to be balanced. As such, it is important to stress on the logic of the implementation of PM system at all levels, at the risk of encountering a rejection, or the resistance by academic staff whose values may be contrary to the managerial values involved (Boitier and Rivière, 2013). Moreover, some scholars have argued the relevance of coupling between PM and organisational objectives. In contrast, Johnsen (2005) has argued that the decoupling between PM and organisational objectives could positively determine the effective implementation of PM in political contexts. The most important questions are connected with the use of PM: How is PM used? Who uses PM? What external or internal factors influence the use of PM?

2.3 Theoretical framework

The topic of the uses and users of PM, within the public sector, has recently attracted the growing attention of scholars (Ammons and Rivenbark, 2008; Grossi et al., 2016; Jansen, 2008; Kroll, 2014, 2015; Melkers and Willoughby, 2005; Pollitt, 2006; Taylor, 2007). PM in public organisations is used by different groups of stakeholders, including politicians (Jansen, 2008; Moynihan, 2016; Van Helden et al., 2016), supervising bodies (Taylor, 2007), the management of particular institutions and their departments (Grossi et al., 2016; Jansen, 2008; Kroll, 2014), society (Jansen, 2008), the mass media and individual employees.

Several scholars have focussed on the possible uses of PM in their work (Behn, 2003; De Bruijn, 2002; Van Dooren et al., 2010). Behn (2003) proposes a categorisation of eight managerial uses, namely, to evaluate, control, budget, motivate, promote, celebrate, learn and improve. De Bruijn (2002) stated that PM could fulfil a number of functions, such as creating transparency, learning, appraising and sanctioning. Johnsen (2005) focusses on the “obstacles” (or costs) of using PM, such as the lack of relevant data, measurement errors, low decision relevance, the proliferation of PMs, information overload, indirect lines of responsibility, no ownership of performance, loyalty to professional norms rather than to the management, the manipulation of data and creaming. Van Dooren et al. (2010) focussed on the hard and soft uses of PM. In that study, hard use presupposes a tight coupling between performance information and decision-making. Soft use is related to loose coupling, as a dialogue and an interpretation that mediates the final decision-making process.

Other scholars (Agostino and Arnaboldi, 2017; Brignall and Modell, 2000; Mimba et al., 2013) distinguish between the rational and symbolic (or ritualistic) uses of PM. Rational use, in the case of the effective use for decision-making purposes, is useful for motivation and learning (Johnsen, 2005; Verbeeten, 2008). Where one stakeholder is dominant and the PM system is related to his or her interest, the PM system cascades down the organisational hierarchy. Hence, it can be expected that PM is functionally used for decision-making purposes (Brignall and Modell, 2000).

Symbolic use is associated with ceremonial adoption and is used to ensure external legitimacy (Meyer and Rowan, 1977). When two or more stakeholders with diverging interests are powerful stakeholders, some forms of the decoupling of PM, between the top and lower levels of the organisation, are likely providing the space for the symbolic use of PM and the “decoupling” of PM with their daily jobs (i.e. not using performance information for managerial and/or evaluation purposes) (Brignall and Modell, 2000; Hoque et al., 2004; Johnsen, 2005). This implies that PM has a role in legitimising the organisation to its stakeholders, but is not really used as an input for decision-making purposes (Mimba et al., 2013). PM systems may be adopted by public sector organisations for ceremonial and symbolic reasons, apart from performance-related issues (Tucker and Parker, 2015).

Past studies on universities have also shown similar rational and symbolic uses of PM. Alach’s (2017) study is related to New Zealand’s eight universities and illustrates a relatively high use of PM and a strong alignment of strategy and PM. On the contrary, Melo et al. (2010) studied a high performing English university and showed that, despite the increase in the measurement of performance in several areas (mostly teaching and research), there seems to be a lack of action, especially regarding individual performance. Moll and Hoque’s (2011) study illustrates how the management of an Australian university attempted to change its internal budgetary system to meet the needs of external stakeholders and gain external legitimacy. Narayan et al. (2017) investigate organisational responses to emerging issues on accountability-autonomy tensions that can be managed within the context of university research commercialisation in two universities in New Zealand.

In our study, we decided to build a theoretical model (see Figure 1) that identifies users and uses of PM in universities, as well as exogenous and endogenous pressures (factors) influencing the use. The adoption and use of PM systems can be considered the effect of several exogenous pressures represented by the isomorphic pressures towards performance-oriented reforms at work over the last few decades. As such, its implementation and use are shaped by endogenous pressures and factors at work in each university. While the exogenous factors would support the development of similar reforms, the specific university can respond with convergent or divergent PM systems under the influence of endogenous factors, in terms of decisions, implementation and use of these practices.

We assume that PM tools can be adopted by universities for legitimacy purposes (i.e. external reporting to national authority or accreditation agencies) and be more influenced by ceremonial motivations, symbolic motivations, decision-making purposes (i.e. resource allocation, efficiency, bonus system), and rational motivations. We assume that the use of PM will depend on a number of influential factors, divided into two main categories, namely, exogenous and endogenous factors (Cavalluzzo and Ittner, 2004; Grossi et al., 2016; Saliterer and Korac, 2013; Van Helden and Reichard, 2013).

Exogenous factors are assumed to influence the use of similar PM. Exogenous factors include stakeholder expectations, external relationships, accreditations, rankings and external evaluations. Endogenous factors can influence the adoption and use of similar and also different PM systems and are divided into two types, namely, organisational and individual. Organisational factors are related to the university’s culture (e.g. entrepreneurial vs traditional), traditions, leadership position and organisational structure (e.g. role of departments, PM systems’ maturity and faculty size). Individual factors that affect the uses of a PM system include personal motivation, reward expectations, training, familiarity with the PM system, faculty position, experience, tenure and rationality.

The empirical part of the paper will explore the exogenous and endogenous factors and investigate the manner and extent of the influence of the internal uses and users of PM on four universities in Poland.

3. Data, methods and the case study context

Qualitative research is useful for exploring phenomena, because it is sensitive to the context and sequence of organisational events and actions (Gephart, 2004; Pettigrew, 1990). Case studies are especially well suited to the dynamics of an organisation (Eisenhardt, 1989). This study uses ethnography as a research methodology, constituted by multiple data collection methods (i.e. participant observations, interviews and archival sources). Ethnography is well suited to helping us better understand the dynamics and process of the environmental change from which they emerge and are shaped (Adams and Larrinaga-González, 2007; Ball and Craig, 2010; Liguori and Steccolini, 2014). It allows a researcher to engage with organisations and draw from the field rationale that could shed new light on how change unfolds over time and how accounting practices interact with the change process to enhance practice (Adams and Larrinaga-González, 2007; Ball and Craig, 2010; Liguori and Steccolini, 2014). Closeness to the people, events, and natural practices within the context of the studies helps produce a rich and thick portrayal of life that is representational and interpretive. It can also persuade the reader that this is the real picture of a studied phenomenon (Putnam et al., 1993).

The empirical part of our research is concerned with the exogenous and endogenous factors connected to the adoption and use of PM in four Polish universities. To conduct our case studies, we selected four universities located in different areas of Poland. These universities are all research intensive and are ranked “A” or “B” in the national research evaluation. This assessment considered four basic criteria: scientific and creative achievements, scientific potential, practical effects of scientific and artistic activity, and other effects of scientific and artistic activity (Law on the Criteria and Procedure for Awarding Scientific Units, 2016). However, only two of the universities (UniA and UniB) have received international accreditations (Table I). The universities have different characteristics, in terms of ownership (two private and two public universities), histories, and sizes, in terms of the numbers of departments/faculties, students, and academic staff. The differences may have an impact on the role, uses and users of PM in the universities. Universities with international accreditations are supposed to be more research oriented than universities without international accreditation.

The data for the case studies were collected through interviews and a wide range of documentary sources (Table AI). To minimise researcher bias and improve the trustworthiness of the data, this paper triangulates the data from internal and external archival sources that include university regulations, rector directives, minutes of senate and rector meetings, accreditation reports, committee meeting minutes and research reports. A total of 40 semi-structured interviews were conducted at the four universities (i.e. 15 at UniA, nine at UniB, eight at UniC and eight at UniD) with university managers and academics of different genders, responsibilities and experiences (i.e. rectors, deans, former deans, deputy deans, research oriented and teaching oriented, as well as junior and senior faculty members). The interviews were conducted in two rounds (i.e. Spring and Summer 2017) and lasted from a minimum of 20 min to a maximum of 1 h and 52 min. All interviews were recorded and transcribed by the authors. The interview questions (Appendix 2) revolved around: the role and users of PM at the institutional, departmental and individual levels; and the uses of PM.

Data analysis was carried out with the use of a computerised tool, MAXQDA, by one member of the research team. The analysis was performed manually by the remaining team members. The differences were discussed to reach a unified conclusion on the issue under analysis. The data analysis helped develop a narrative of how PM is implemented and used in the four chosen universities. Special attention was paid to the analysis of the rational and symbolic uses of PM (Figure A1).

4. Findings

4.1 Exogenous factors affecting the PM systems

The higher education market in Poland is rather saturated, with over 400 higher education institutions, out of which almost 70 per cent Polish were non-public (private). The recent demographic changes and price sensitivity of the market participants create tensions and uncertainty in relation to future development and sustainability (Dobija and Hałas-Dej, 2017). The recent years have brought about a wide debate on the ways in which the higher education system should be shaped so that the educational market becomes more internationally competitive, and is able to affect the innovativeness and creativeness of the Polish economy. Further, stakeholders have been involved in the debate and as a result, new regulations on higher education is going to be introduced in October 2018.

The Polish higher education system can be described as highly regulated. Much like other European higher education institutions, Polish universities are part of the European higher education area. At the national level, all universities in Poland, both, public and private ones are subject to regulations included in the Parliamentary Acts. One of the features of the Polish higher education system is that responsibility for the quality and standards of the qualification structure is split between the Act on Higher Education (2005), which regulates the higher education system, organisation, governance, and supervision of the higher education institutions and the Law on Academic Degrees and Title (2003), which regulates matters related to academic qualifications and titles.

Law on Higher Education (2005) stipulates the creation of a Polish Accreditation Committee (PAC) that will be responsible for ensuring the high quality of higher education. The PAC will conduct periodic, compulsory accreditations of all undergraduate and graduate academic programmes as well as institutional accreditations. These evaluations are considered important as the results of the evaluation can have important consequences. Those schools, both, public and private ones, with a positive evaluation with distinctions can be awarded substantial additional financing with the aim of improving the quality of education. A negative evaluation by the PAC would result in the withdrawal of degree granting rights by the MSHE.

The structure of Polish academic qualifications has been modelled like the structure prevailing in France or Germany with two academic degrees of PhD and doctor habilitatus (habilitation) and the title of professor. The Act on Academic Degrees and Titles (2003), also regulates the existence of the Central Commission for Academic Degrees and Titles (CCADT) – a committee to the Prime Minister responsible for ensuring the development of academic qualifications. The committee administers all applications for PhD, habilitations and the academic title of professor. The Act also sets a minimum performance requirement before an individual person can be awarded an academic degree or title. Financing of research activities is directly linked to the outcome of the periodic evaluations of the scientific unit of higher education institutions by the Committee for Evaluation of Scientific Units (CESU) (Law on the Principles of Financing Science, 2010). CESU is a consultative and advisory body to the MSHE. It is responsible for monitoring the scientific excellence of scientific units of higher education institutions. The CESU is also responsible for setting the evaluation criteria as well as for conducting the evaluation. As a result of the evaluation, the scientific units are grouped into different scientific categories. Both, public and private higher education institutions, can be evaluated. The outcome of the evaluation is then linked with different levels of financing of research related activities and faculty development.

The results of both evaluations conducted by SECU and PAC have important impacts on the level of financing granted to higher education institutions. It is, therefore, not surprising that the universities, including business schools, try to adjust their PM systems to the requirements set by the evaluators. This is, however, not an easy task as the systems of evaluation, especially the scientific ones, have been continuously subject to change, and the rules of the game have not been usually known until the evaluation is administered. This creates instability in the internal PM systems and affects the behaviour of individual academics. This is discussed in the section below.

Higher education in Poland has recently been under pressure for internationalisation. In general, the level of internationalisation is considered to be low, as the Polish universities have ranked low in general university rankings. However, some business schools began to join the bandwagon of internationally accredited schools and many more aspire to join the group. This is also possible due to the recent decision made by the MSHE to cover administrative costs of the accreditation process as well as the accreditation fees. This trend, however, puts greater pressure on individual academics as well as the entire institution in terms of performance, and can be also seen as one of the factors affecting the change in the internal PM systems.

4.2 Endogenous factors affecting the PM systems

To understand the functioning of the PM system in the four universities better, interviews were conducted with a focus on the main activities that comprise a university’s mission (i.e. research, teaching and third mission). A summary of the findings is presented in Tables II–V.

Despite the differences in the length of using the PM system as the main motivation for development, the main features of the systems are quite similar, focussing on three aspects of performance, namely, research, teaching and contributions to society. External factors seem to be the main reasons for the implementation and use of PM in all four universities. The PM systems at all universities tend to be driven by the expectation of the main external stakeholders to track and measure strategic goals, targets, and achievements. One major difference is related to the definition of the main stakeholders, as reflected in the strategies of the four analysed universities. In the case of the two public universities, it seems that the Polish MSHE, as the main provider of funding, alongside the state accreditations and evaluation committees, are the main drivers for implementing PM:

We report on the accomplishments and actions that reflect what is considered by the ministry while evaluating higher education institutions […] the system has be regularly adjusted to the criteria imposed by the ministry

(Interviewee P21).

In all four universities, PM is related to research, teaching and a third mission. PM is mainly decided in the interactions between the departmental and central administration, as part of the internally developed PM system. Some of this information has to be prepared and delivered for an external assessment by national actors (i.e. MSHE, PAC, CESU, ACG, CCADT and accreditation agencies). In UniA and UniB, it also needs to be prepared and delivered by international accreditation agencies. In the case of internationally accredited schools, internal accreditation offices often play a mediating role in the design and implementation of teaching performance measures related to individual academics and departments or faculties.

Research performance constitutes an important element of PM systems in all universities. In all four cases, the performance measures of research are connected to individual and organisational outputs, such as the number of publications in journals listed in national rankings, participation in conferences, as well as grants and awards. For the two universities (UniA and UniB) with international accreditation, there is a growing pressure to publish in journals with high impact factor that are listed in international journal rankings (e.g. JCRs, ABS). This is also reflected in PM, especially at the individual level. More specifically, two of the interviewees stated that:

We all participate in this arms’ race to publish the best publications, in the best journals, with the highest points

(Interviewee P5).

The main part of the current individual performance assessment is the publication achievements in highly ranked journals […] if you wish to remain in the place where you are [at the university] you need to get a positive assessment, and it is obvious. We are stressed by this assessment

(Interviewee P18).

The performance measures, in relation to teaching, in all universities, are based on traditional, quantitative metrics with few innovations (e.g. direct teaching hours, number of bachelor’s/master’s/doctoral students). Moreover, concerning teaching, all universities implemented student evaluations using online surveys. They periodically organised peer review observations of classes performed by other staff. Only one university seemed to pay more attention to PM related to teaching and noticed the drawbacks of the current PM, due to the small response rate and the decreasing relevance of the information received through the online system. Consequently, UniA introduced an innovation that measures the teaching quality by using a focus group. This new solution is expected to provide more valuable and accurate information on the teaching performance of the individual, as well as that of the programme.

As for the third mission, the PM system takes into account the different output measures in relation to individual academics (e.g. consulting projects, expert team membership, boards, and associations). However, this PM is mainly considered supplementary information to the performance information on research and teaching:

Whenever I do consulting work […] participate in boards, I report it […] we do not get any additional points for those, but each of us can list what we do

(Interviewee P39).

Similar to research PM, accreditation offices are often playing a mediating role in the implementation of the system, due to the importance of the third mission in the overall evaluation of external evaluations and accreditations.

The management of all institutions declares that the use of PM is provided by the system. However, the major difference between the cases seems to be in understanding how academics use this information at the strategic level. Almost all of the academics at UniA clearly link the PM systems to the school’s strategic objectives and goals. The faculty members also seem to understand how the system functions, especially when it comes to the expectations towards individual performance. In the other three universities, the faculty PM system is less clear for the individual academics. Additionally, most academics have little knowledge of, or familiarity with, the way PM is used at the school level, although the interview results suggest the awareness of the increasing internal pressures to use the PM at the strategic level.

4.3 The uses and users of PM

In the traditional, classical management accounting literature, PMs are considered an important part of the PM systems (Broadbent, 2011; Martin-Sardesai et al., 2017; Otley, 2003, 2016). Universities are not different from other public organisations and can use PM for rational purposes to make operational and strategic decisions internally, with the goal of the efficient use and allocation of the available resources (Ansari and Euske, 1987; Baxter and Chua, 2003). However, PM can be also used in the wider context of the external stakeholders and society. Organisations can also adopt PM for symbolic purposes, aiming at external legitimacy (Tucker and Parker, 2015). This need of the symbolic use is especially important in the case of public organisations, including universities (Moll and Hoque, 2011).

In this section, we provide empirical evidence of how PMs are used in the university context and who is using this information. We use our theoretical model to organise the discussion by first focussing on the different users (i.e. internal and external) of PM. We use the empirical materials collected to provide evidence and examples of the different uses (i.e. rational and symbolic) of PM within the two main groups of users analysed in the paper. A summary and synthesis of the findings for each case are provided in Tables II through V.

A common example of internal and rational use provided by interviewees were decisions connected to employment. In all four universities, research achievements are considered by the university authorities for decisions regarding promotions, as well as the hiring and dismissal of employees. In three universities (UniA, UniB, UniD), the PM results connected with research are also considered during the allocation of internal grants for research projects and international conferences.

In the case of UniB, some of the respondents pointed out that the only rational use of formally reported information on their achievements is reflected in the decisions related to the employees being made by school authorities. According to two respondents, this information is the basis for extending a contract or dismissing an employee:

[…] the evaluation, as such, is used to renew the contract

(Interviewee P17).

If one’s employment agreement is prolonged, it may mean that one has a positive rating. If it is not prolonged, or one is not promoted, reasonable grounds need to be established

(Interviewee P18).

There seems to be some ambiguity about the use of PM, because when asked if they knew of any cases of dismissals based on the formalised PM, both, employees and the school authorities could not provide an answer. It can, therefore, be presumed that the use of PM for decisions related to employees is, to some extent, symbolic:

The management […] draws up the rankings of employees who have obtained a certain number of points, for example, for publications […]. Those who are at the bottom of this ranking become the subject of discussion about what to do with them […], because if someone has not published a single article for six years, has no counselling achievements, and is not particularly liked by students, well, then you ask yourself why this person is still here with us

(Interviewee P22).

Similarly, in the case of the second private university (UniC), empirical materials show that the use of PM is mainly symbolic. Rational choices are focussed on decisions related to the hiring and dismissal of employees. According to one dean:

If one does not actively support the university, does not publish. What is the point of prolonging the contract, right?

(Interviewee P32).

Empirical evidence indicates that annual staff meetings, organised at UniC, have a rational purpose. Interviewees point to its twofold role. On the one hand, during staff meetings, the overview of the skills and achievements of academics is performed. The main purpose of this appears to be motivational, thus serving a rational use. At the same time, the symbolic dimension of those meetings is visible, as specific academics are publicly praised and honoured. The meeting is to celebrate distinguished researchers and lecturers. The following citation from one of the deans illustrates the dual role of annual staff meetings:

Meeting as we do today [annual staff meeting] is a perfect example of how we use that information […] so we meet and talk for several hours about what we have done, specific names are mentioned, and this is all used for internal propaganda. To motivate. It works very well

(Interviewee P26).

Similarly, the deans also indicated that PM is important for motivation purposes:

Whenever there is a person that publishes a lot, we mention him or her and say – you should compete with him or her, look at his or her articles – so we present those most active researchers

(Interviewee P26).

Each employee is discussed during meetings […] the talent is appreciated […] if he/she works for the benefit of the institution, it is praised

(Interviewee P25).

Rational use at the departmental level was rather limited in three (UniB, UniD, UniC) out of four universities. It was emphasised that informal information is mostly used. Employees usually know each other very well and know what their colleagues do. The head of the department can assess employees based on direct contact and observations. In the case of UniB:

At the department level, there exists informal knowledge of what and how one does […]; if someone is the boss for many years, he/she may have a qualitative view of their employees

(Interviewee P17).

At UniA, the empirical data illustrates both, the rational and symbolic use of PM at the departmental level. The rational use of PM is reflected in making relevant decisions by heads of departments, such as those relating to the equal allocation of organisational tasks:

Information on organisational work is considered by the heads of the departments while allocating tasks and university responsibilities […] so there is an equal, proportional distribution between the employees […] we do not want one person to do everything

(Interviewee P3).

In addition, only some interviewees from UniA indicated that the PM system is rationally used, not only to control the staff, but also for learning purposes. Through this system, they are informed about the research and achievements of scholars from other departments. Thanks to this, they can cooperate with each other if they conduct research in similar fields of study or exchange good experiences on their activities. Therefore, they learn how to develop research and improve outputs:

[…] and I use performance information, in the sense that we form some groups and we are working on a topic […] it made me realise that other people have similar scientific interests and they face the same problems as I do. […] Performance system support networking and, basically I found out that it is just great fun to put two or more people in the paper and conference presentations and that good things come out of it

(Interviewee P15).

The research office [at UniA] organises many meetings with employees who won grants [funding for research] and have been published in international journals, to learn from them and to encourage research work

(Interviewee P1).

At the individual level in the four universities, academics use PM for several rational purposes: to plan one’s own academic development (career), to increase their knowledge about their colleague’s work, to be more goal oriented, and to increase their motivation and satisfaction. Academics that choose to conduct research and seek to obtain higher academic degrees are obliged to collect information about their scientific achievements, as their assessment is the basis for awarding habilitation by the external state commission (CCADT). More specifically, one interviewee stated:

[…] the more measurable the scientific contribution, the better, because it is easier to put it later in the documentation for habilitation

(Interviewee P35).

Throughout the interviews, it was determined that the results obtained in teaching and research are often used in both, a symbolic and a rational manner. In all four universities, PM results are used to award outstanding research achievements and from this perspective, it explains the rational use of PM, even if the targets and awards differ among universities. However, the awarding process itself has a highly symbolic dimension, because they are recognised during annual ceremonies. In UniA, awards are given for articles published in journals on the ABS list or with an impact factor. At UniC, each publication is awarded during the aforementioned annual staff meetings. Similarly, the value of the award differs. At UniA, it is a monetary award, which depends on the position and income of the employee. At UniC, there is no monetary incentive. Nonetheless, in each university, there is a public ceremony, with the rector awarding the certificate, serving as the symbolic use of the PM. According to one interviewee:

It is clear that awards are an attempt to promote achievements and to set certain people as role models

(Interviewee P3).

At UniD, the assessment of researchers itself does not have a direct link to their financial bonuses. The motivational system is based on the use of information on obtaining further academic degrees and publications to reward employees. The Rector Award for scientific publications can be awarded to employees who have collected a minimum sum of points for all of the articles that they have published in scientific journals. According to some of the respondents, the Rector Award is purely symbolic. It is not a real attempt to motivate employees to make an effort and prepare high-quality papers that would have a chance of being published in international journals. More specifically, one interviewee said:

[…] satisfactory, good, very good or excellent grades do not significantly affect the level of remuneration of an employee, if there is no scientific promotion connected with it. Of course, employees who have outstanding achievements receive the Rector’s Award, which is perhaps some financial incentive. However, this is not important enough to motivate employees

(Interviewee P40).

At the level of the university authorities, in the case of UniA, respondents emphasised that the PM plays a strong promotional role for the university, both, with external and internal stakeholders. Thus, PM is used for symbolic, marketing purposes through dissemination via social media and internal newsletters. The aim of promoting good research is motivational, on the one hand, and informational, on the other. According to Interviewee P1:

We do it so that employees know who does what […] to motivate others

(Interviewee P1).

In all four universities, the use of PM, in a symbolic manner, was observed. PM is mainly to legitimise themselves in the eyes of various stakeholders, including employers, students, accreditation and ranking agencies, states, and mass media. Additionally, some faculty members are of the opinion that getting an award involves a certain level of prestige:

Of course, all of our accomplishments end up in the grantees

(Interviewee P15).

All the information on publications and research projects are used by the research office to put in upfront to the media (Interviewee P12). Among the people who aspire for a scientific prize, there is definitely some competition in this field […] my colleagues who receive these awards notice who has won the prize during the academic year, […] it is associated with certain prestige, which is of greater importance than any financial prize, for me

(Interviewee P35).

At the departmental level, the empirical evidence points to symbolic use. In the case of UniA, the heads of the departments use information on achievements to honour individuals and present them as role models to the other faculty members. On the other hand, the department leaders revealed, that there is a rational premise to use both, PM and final information, to motivate employees:

Heads of departments always point to outstanding individuals during meetings to appreciate and motivate

(Interviewee P10).

At the individual level, symbolic use was only found at UniA. There, interviewees emphasised on the role of PM in building their own personal brands, recognisability and their area of expertise within the university:

It is quite obvious, that if someone submits an article, and the article is accepted, then they would talk and “brag” about it

(Interviewee P1).

When someone publishes a lot in good journals, then he/she is perceived as great […] I know that I tried to publish in better journals because of this, and not because the university makes me do so

(Interviewee P13).

We have to present ourselves to each other, to exist in the consciousness, that this is what we do, and those are my topics of expertise

(Interviewee P15).

PM on teaching and research are closely analysed, especially in relation to the need to prepare it for external users (e.g. MSHE, national and international accreditation agencies) responsible for monitoring university performance and compiling and publishing the rankings of business schools. One of the respondents at one public university (UniB) highlighted that the use is mainly symbolic:

Maybe in private schools it happens that someone has invented such a system of management […] in order to make rational decisions […] It is not so here; our system has been imposed from the outside and we just have to apply it. It follows some formal regulations

(Interviewee P22).

Similarly, an interviewee at UniC emphasised that PM is mainly used for external reporting purposes:

There are certain indicators that we are obliged to, right? Those that we have to report to external [stakeholders]

(Interviewee P28).

The symbolic use of PM is visible, especially at UniC, as the role of performance information that is mainly limited to external reporting purposes. Respondents from UniC highlighted some criticalities (e.g. lack of standardised information, regulations, and proliferation of bureaucratic requirements) in relation to PM, both, in teaching and research activities. The empirical evidence did not reveal how often the quality of teaching is measured or what the minimum targets for publications are, as the received answers were conflicting:

6 publications, each 10 points minimum

(Interviewee P28).

2 publications, 10 points minimum

(Interviewee P30).

It used to be 20 points annually, but I think it has changed now

(Interviewee P26).

2 publications annually

(Interviewees P27; P32).

4 publications annually

(Interviewee P29).

One of the deans claimed that no target exists for publications:

There is no specified target […]. There is no minimum, no maximum […]. There is no need for them […] because it would not be proper not to publish at all

(Interviewee P25).

Thus, the use of the collection and the use of the PM at UniC seems to be, in large part, symbolic and dedicated to external users.

Despite the evidence of the use of PM internally, for both, rational and symbolic purposes, the empirical data points out the negative consequences of the system (Pop-Vasileva et al., 2011; Kallio and Kallio, 2014). The unintended consequences placed on individual scholars included more stress, conflicts, and time invested for self-assessments. This was also visible in our interviews. Such consequences were especially visible in the university in which the PM system was mostly developed and used both, symbolically and rationally (UniA). In remaining universities, the stress related to the PM system was also visible:

We know that if we stop publishing, then it will not end well for us […] we will not be attractive for the university anymore

(Interviewee P27).

I don’t know if it motives or demotivates, it for sure stresses, I can say that with confidence

(Interviewee P37).

The respondents presented a sceptical view towards certain measurements. Some academics believed that neither the number of publications, nor the rank of the journal, reflected performance. The actual contribution to science cannot be measured. Similarly, the rating of journals does not indicate how much effort the employees put into the preparation of a certain research article:

I work on an article, which is very difficult and it takes me a lot of time, and someone in the same time may publish 5 articles and it would take the same amount of time as this one difficult article took me. So, it is not comparable. I am not a fan of those journal points, either, It is imperfect, but at least it showcases whether the journal is demanding or not

(Interviewee P15).

When it comes to the students’ evaluation of the quality of teaching, a major concern of the interviewees was towards the unequal, incomparable number and structure of the students involved, as well as the lack of reliability:

I wouldn’t say that it [students’ surveys] measures my performance or quality of teaching […], rather, it measures their emotional attitude towards the lecturer

(Interviewee P11).

It still requires a lot of work, so, for example, the student’s surveys are reliable, it has to be ensured that not only the number of evaluators is adequate, but also the structure

(Interviewee P1).

PM was used across different levels in UniA in both, a symbolic and a rational way. Hence, interviewees were able to notice the potential drawbacks of the system and were able to question its adequacy. In the remaining researched universities (UniB, UniC and UniD), the interviewees did not raise any objections related to the adequacy of PMs and their use.

In conclusion, the implementation and use of PM systems in the four universities were clearly positive. There were also critical effects observed, both, at the organisational and the individual levels. The positive issues were related more to transparency and legitimacy, credibility, and image towards external users (e.g. state, accreditation agencies, employers, students, and mass media). It should be emphasised that interviewees had trouble distinguishing among specific public bodies that supervise and assess the academic activities (e.g. CCADT, ACG and CESU were referred to as the MSHE).

The use of PM has also had a positive impact on internal decision makers (e.g. rectors, deans, heads of departments, individuals and academics) in increasing the rationalisation of resources, learning about work activities, individual motivation, goal orientation and the introduction of incentive systems. Interviews also revealed critical effects (e.g. symbolic use of PM, data errors, data manipulations, proliferation of bureaucracy, more stress, myopia, less motivation, less collaboration and several critics of the system).

5. Discussion and conclusions

The PM systems at the universities under study were recently developed with the change of expectations set by the Polish government, and, more broadly, the public sector reforms that have been strongly influenced by the new public management principles, and the wider European context of university reforms (Agyemang and Broadbent, 2015; Boitier and Rivière, 2013; Broadbent, 2011; Kallio and Kallio, 2014; ter Bogt and Scapens, 2012). The results of national evaluations by PAC and CASU are linked with the level of financing, in that sense that the PM systems are significantly influenced by the coercive pressure for reduced government budget dependence and greater value for money (Parker, 2011).

When it comes to PM in our Polish university cases, especially in UniB and UniA, there seems to also be a strong emphasis among national stakeholders on performance needs that are driven by the expectations set by the international accreditation agencies (Ahrens and Khalifa, 2015). The cases of UniA and UniB demonstrate the ambition of competing in the international education market and benchmarks with other top European business schools. Governmental actors and the evaluations by PAC and CASU still play a role in the way in which the PM systems have been designed, but the system that measures performance, especially in the case of UniA, resembles the expectations set forth by the ranking and accreditation agencies more closely. International research excellence is an important part of the school’s strategy, which is clearly communicated to the faculty members. The empirics of the paper confirm that the existing PM systems in those two schools are the results of mimetic isomorphism, as “market followers” are copying “market leaders” in commercialisation (Parker, 2011) and joining the bandwagon of internationally accredited schools.

Taking a perspective that the use of PM is recognised as playing a key role in internal decision-making, but also in the external accountability purposes of public organisations (Czarniawska and Genell, 2002; Lee, 2008; Tucker and Parker, 2015), we analyse the existing PM systems and de facto uses and users of PM. The four cases presented in the empirical section above provide an interesting basis for the comparison and analysis of how PM is implemented and used in the university context. The results of the four cases indicate different practices in relation to diversity in PM at the four universities.

Czarniawska and Genell (2002) suggest that by complying with an organisational model and legitimate language of performance, universities may try to maintain a loose coupling between operational reality and the window-dressing they wish to display to external stakeholders. A managerial culture has increasingly informed the research agenda and accountability has become a powerful force in reflecting the needs of different stakeholders to reach the exploitation potential of university research (Narayan et al., 2017).

The empirics of the paper document that PM is used both, in strategic and rational decisions, as well in external accountability. In general, in all the studied cases, the PMs on research and teaching are used by internal actors (e.g. vice-rectors for research, teaching, academics, heads of departments and other university managers) and also for external accountability purposes towards national actors. Additionally, in the case of internationally accredited schools, PMs are used to satisfy the information needs of the international accreditation and evaluation bodies. In relation to the third mission of universities, performance does not seem to be a major point of concern in daily operations, but it is considered relevant for external visibility.

In all universities, the leadership and managers attempted to rationalise available resources. However, the extent and scope of PM use by internal actors were found to differ among university levels (central or department/faculty level) in each university. Organisational factors, such as culture, leadership, maturity of the PM system, size, ownership, and the perceived roles of the department, seem to affect the way in which PM is used in the four universities. The performance of individuals is translated into quantifiable metrics to obtain information on strong and weak individual performances, as well as the performance of the departments and the entire institution.

PMs that are related to individuals are mainly used for faculty management decisions. Our research also confirms that the general trend of the increasing use of PMs in operational decisions may lead to undesired consequences. Similar to other international universities (e.g. Australia, Finland, France, New Zealand, Sweden and the UK), Polish academics are experiencing an increasing level of job stress and declining job satisfaction, with excessive workloads and external assessments as major contributing factors (Agyemang and Broadbent, 2015; Boitier and Rivière, 2013; Kallio and Kallio, 2014; Pop-Vasileva et al., 2011).

Achieving high legitimacy with key external stakeholders is important for all public organisations. Universities operating in the public sector experiment with innovative changes imposed by national PAC and CASU to gain legitimacy in the eyes of external constituencies, because of various pressures and influences (Agyemang and Broadbent, 2015; Broadbent and Guthrie, 1992; Czarniawska and Genell, 2002; Hoque et al., 2004; Melo et al., 2010). Our empirics confirm that universities are using PM for accountability purposes, in the eyes of external actors at the national level (MSHE, PAC, CASU), but also in the case of internationally accredited schools by international accreditation bodies. Moreover, the picture portrayed in the empirical section directs more attention to the use of PM for symbolic reasons, as a signal of internal transparency, image, and reputation at the individual and departmental levels or for the research group (Brignall and Modell, 2000). This is particularly visible at UniA, which has been experimenting with the PM system for a much longer time than other universities have. In this case, PMs are used to monitor progress in achieving objectives and goals, to build a personal brand (image) of a successful researcher and for social comparisons.

The analysis of the four cases illustrates that PM systems are not a neutral technical tool. Their application and utilisation are heavily dependent on the attitudes and reactions of different internal actors involved in the process (Bouckaert, 1993; Taylor, 2009). When the main motivation of the promoters of the systems is just to gain legitimacy in the eyes of external stakeholders, by conforming the organisational model to the language of performance, individual actors tend to negate the usefulness of the system and often develop resistance strategies at the micro-level (Czarniawska and Genell, 2002; Modell, 2003). When the PM systems are successfully institutionalised and the goals of the individuals and organisations are linked, PM can be considered a useful and rational tool for supporting the decision-making process, thus, leading to improvements in efficiency and effectiveness (Mouritsen, 1994).

This study also confirms that the use of PM is also dependent on endogenous factors related to organisations (such as organisational culture, system maturity, and information quality) and individuals (such as teaching/research work orientation, motivation, academic position and achievement, familiarity, and the ownership of the system) (Grossi et al., 2016; Kroll, 2014, 2015; Moynihan and Pandey, 2010; Saliterer and Korac, 2013).

The paper makes significant contributions to the accounting and public management literature and to the theoretical understanding of how the PM is used and who the users in the university context are. Our paper argues that much of the current debate of the PM system development is based on a narrow understanding of how decision-making actually takes place within universities. Contributing to the study of PM in universities, this research emphasised the exogenous and endogenous factors leading to such development. The existence of institutional pressures and organisational responses are suitable for shedding light on the different features finally assumed by accounting practices. Indeed, the development doctrine should benefit more from rational and institutional views on PM in the public sector, since the question is not only about the reasons of diffusion of PM, but also about something more fundamental in the ways in which it is used by internal and external actors within universities. Our findings have contributed to this debate, pointing out the need to consider and integrate the possible use (rational vs symbolic) of the PM and the context (institutional, organisational and individual factors) where it takes place. In particular, the paper highlights PM practices in a transitional context (Poland) located in Central and Eastern Europe.

Our results are also useful for policy-makers, university managers, and academics that are responsible for redesigning the current and future university PM systems. During this process, more considerations on the internal usefulness of PM should be taken into account.

This paper is subject to a few limitations. First, it involves a study of only four universities. Hence, it is not possible to confirm that the findings are mirrored across the higher education sector throughout Poland. The study can be extended by incorporating more cases into the analysis. Additional insight could be gained if the sample is extended internationally in other Central and European countries. Cross-country comparisons could shed more light on how internal and external stakeholders apply and use PM. Further studies could also investigate the impact of international organisations, such as rating and accreditation agencies, regarding the extent and scope of the use of PM.

Today’s universities are complex and hybrid. Only a small number of faculty members for each case were included in the paper’s sample. For this reason, additional studies could use different collection methods, such as large N-surveys, to obtain more detail on the use of PM in universities. Further studies could also address the issue of how PM use has changed over time, at different levels of decision-making, and how, external perceptions of the roles of universities and their management affects the use of PM.

Figures

Users and uses of performance measurements in universities

Figure 1

Users and uses of performance measurements in universities

Example of a coding tree

Figure A1

Example of a coding tree

Four Polish universities

University UniA UniB UniC UniD
Ownership Private Public Private Public
Year established 1992 1816 1994 1925
International accreditations EQUIS, AACSB, AMBA EQUIS (since 2018) AASBI, AMBA NO NO
National parametric evaluation A A A (B since 2017) A (B since 2017)
Habilitation granting rights Yes Yes No Yes
Number of faculties 2 21 3 5
Number of departments 27 218 23 62
Number of students 8,000 47,600 15,000 (3,500 in Łodz, the rest in 14 other campuses in Poland) 23,000
Number of academic staff 242 3,760 257 617
Governance actors Board of trustees
President
Rector
Vice-rectors
Directors of colleges (Two directors in the rank of Vice-rectors)
Vice-directors of colleges
Rector
Vice-rectors
Deans
Vice-deans
Rector
Vice-rectors
Deans
Vice-deans
Rector
Vice-rectors
Deans
Vice-deans

UniA summary of findings

Who uses What uses (Examples of uses)
Area Measurement (Examples of measures) Internal External Rational Symbolic
Teaching Hours of lectures in Polish and English (targets depending on position), guest lectures
Students evaluation (online survey)-number of bachelor’s/master’s/doctoral students
Cyclic peer observation of staff
Evaluation of students reports and exams by quality of teaching office
Number of case studies/materials/textbooks prepared, used and shared in UniA
Reported employee
Head of department
Deans and rectors
Research and teaching office
Accreditation office
Quality of teaching office
Individuals
MSHE
PAC
CCADT
CESU and ACG
International and national accreditation bodies
International and national ranking institutions
Self-evaluation of employees and departments
Allocation of tasks/teaching hours
Internal individual performance evaluation
Self-development in teaching (based on feedback)
Self-motivation
Rector awards (monetary and symbolic diploma)
Recognition in department
Rector awards for teaching (diploma)
Recognition
Reports for international accreditation agencies, MSHE and PAC
Research Points for publications (targets depending on position)
Participation in conferences (with distinction to international and national conference)
Won grants/awards
Cyclic interviews with authorities (every 2 or 4 years, depending on the seniority of the employee)
Reported employee
Colleagues
Head of department
Deans
Rectors
Research and teaching office
Individuals
MSHE
PAC
CCADT
CESU and ACG
International accreditation bodies
National ranking institutions
Partners (companies, other universities)
Students
Self-evaluation and comparison with colleagues/benchmarking
Internal individual performance evaluation
Finding researchers for projects
Promotion/demotion
Allocation of UniA grants
Overview of skills/accomplishments in UniA
Planning individual career paths and obtaining academic degrees
Self-motivation to publish in top ranked journals
Dissemination/promotion by marketing office and research and teaching office
Rector awards for research (monetary and diploma, for every publication with an impact factor or from an ABS list)
Recognition
Reports for international accreditation agencies, MSHE and PAC
Third mission Consulting projects
Inviting new partners
Membership in expert teams set up by state bodies and foreign or international institutions
Rectors
Research and teaching office
Accreditation office
MSHE
CCADT
CESU and ACG-international accreditation bodies
Internal individual performance evaluation Recognition
Reports for MSHE

UniB summary of findings

Who uses (Internal/external) What uses (examples of uses)
Area Measurement (examples of measures) Internal External Rational Symbolic
Teaching Number of teaching hours (min. depending on the position)
Student evaluations (online survey)
Peer observation of young faculty members (rare practice, lack of mentoring)
Number of promoted students (bachelor’s, master’s, PhD graduates)
Number of full-time and part-time students
Number of postgraduate students
Deans
Rectors
Research and teaching office
Head of department
Individuals
MSHE
PAC
CCADT
CESU and ACG-national ranking institutions
International accreditation bodies
Internal individual performance evaluation
Self-motivation
Dean’s performance allowance amount (motivational bonus)
Reports for PAC, MSHE and international accreditation agencies
Research Tasks performed
Obtaining higher scientific (academic) degrees (PhD, associate professor (habilitation), professor)
Points for publications
Number and specification of realised scientific projects and number of filed applications
Citation rate
Received awards (e.g. Ministers’ awards, Prime Minister’s awards)
Rectors and deans
Head of department (mostly informal PM, rather than formal reports)
Individuals
MSHE
PAC
CCADT
CESU and ACG
National ranking institutions
International accreditation bodies
Internal individual performance evaluation
Dividing public financial sources between departments and individual research projects
Planning individual career paths and obtaining academic degrees
Self-motivation
Dean’s performance allowance amount (motivational bonus)
Rector awards (monetary and diploma)
Recognition
Reports for PAC, MSHE and international accreditation agencies
Research evaluation
Third mission Consulting
Membership of supervisory boards
Participation in expert work (reports)
Work and cooperation with state and local governments
Membership in associations
Rectors
Deans
Head of department (mostly informal PM)
Individuals
MSHE
CCADT
CESU and ACG
Internal individual performance evaluations Dean’s performance allowance amount (motivational bonus)
Research evaluation

UniC summary of findings

Who uses (Internal/external) What uses (examples of uses)
Area Measurement (examples of measures) Internal External Rational Symbolic
Teaching Number of teaching hours (targets depending on position)
Student evaluations (paper survey)
Cyclic peer observation of staff
Head of department
Rectors
-individuals
Research and teaching office
MSHE
PAC
CCADT
CESU and ACG
Hiring and dismissal
Allocation of additional classes taught in English (as a reward)
Self-motivation
Recognition diploma (for best lecturers)
Reports for PAC, MSHE
Research Points for publications (targets not clear)
Participation in conferences
Presentation of plans for future publications/research
Head of department
Rectors
MSHE
PAC
CCADT
CESU and ACG
Hiring and dismissal Recognition diploma (for any publication)
Recognition
Reports for PAC, MSHE
Third mission Reports on consulting projects, cooperation with companies Deans
Research and teaching office
MSHE
CCADT
CESU and ACG
No answer Reports for MSHE

UniD summary of findings

Who uses (Internal/external) What uses (examples of uses)
Area Measurement (examples of measures) Internal External Rational Symbolic
Teaching Number of teaching hours (min. depending on position)
Student evaluations (online survey)
Number of bachelor’s/master’s/doctoral students
Peer observation of young faculty members
Number of promoted students (bachelor’s, master’s, PhD graduates)
Number of didactic publications per year
Deans and rectors
Head of department (mostly informal PM, rather than formal reports)
Individuals
MSHE
PAC
CCADT
CESU and ACG-national ranking institutions
Internal individual performance evaluation
Allocation of additional courses and trainings
Rector awards (monetary and symbolic diploma)
Recognition
Reports for PAC and MSHE
Research Evaluation of the progress towards academic degrees
Number of scientific articles in national and international journals and scientific monographs
Points for publications
Total number of presentations during national and international conferences
Number of scientific projects and number of filed applications
Citation rate
Rectors and deans
Head of department (mostly informal PM, rather than formal reports)
Individuals
MSHE
PAC
CCADT
CESU and ACG-national ranking institutions
Internal individual performance evaluation
Dividing public financial sources between departments and individual research projects
Planning individual career paths and obtaining academic degrees
Self-motivation
Rector awards (monetary and symbolic diploma, for sum of publications of minimum 35 points)
Recognition
Reports for PAC and MSHE
Third mission Participation in governmental bodies (e.g. PAC)
Participation in expert work
Experience in business and public administration
Membership on supervisory boards
Publications in popular journals
Rectors and deans
Individuals
MSHE
CCADT
CESU and ACG
Internal individual performance evaluation Recognition
Reports for MSHE

Data sources

Data sources Duration
Total Interviews, n= 40
UniA, n= 15 17 h 17 min
Profile of personnel interviewed Coded Duration
Vice-rector, Research and Teaching P1 1 h 48 min
Head of Department, Management P2 50 min
Head of Department, Marketing P3 1 h 30 min
Head of Department, Business Strategy P4 55 min
Assistant Professor, Department of Social Sciences P5 24 min
Senior Lecturer, Department of Social Sciences P6 49 min
Rector, Head of Department, Quantitative Methods and Information Technology P7 46 min
President P8 1 h 13 min
Head of Department, Human Resources; PhD Programme Director P9 1 h 52 min
Assistant Professor, Department of Marketing P10 1 h 15 min
Assistant Professor, Department of Marketing P11 1 h 12 min
Assistant Professor, Department of Management P12 52 min
Assistant Professor, Department of International Management P13 1 h 52 min
Secretary of Department, Business Strategy P14 1 h 1 min
Research Assistant, Department of International Management P15 1 h 8 min
UniB, n=9 10 h 18 min
Assistant Professor, Department of Finance and Accounting P16 30 min
Senior Lecturer, Department of Entrepreneurship and Management Systems P17 40 min
Senior Lecturer, Department of Organisational Theory and Management P18 1 h 50 min
Dean, Head of Department of National Economy P19 54 min
Vice-Dean for Research and Liaison; Head of Department, Management P20 38 min
Head of Department, Organisational Theory and Management P21 1 h 50 min
Head of Department, Entrepreneurship and Management Systems P22 1 h 30 min
Associate Professor, Department of Marketing P23 1 h 5 min
Associate Professor, Department of Marketing P24 1 h 21 min
UniC, n=8 5 h 25 min
Vice-Dean, Head of Department, Management P25 1 h
Dean, Department of Finance P26 35 min
Assistant Professor, Department of Marketing P27 40 min
Research and Teaching Assistant, Department of Marketing P28 20 min
Head of the Research Centre P29 30 min
Head of the Managerial Accounting Unit, Department of Accounting P30 40 min
Assistant Professor, Department of Marketing P31 40 min
Dean, Department of Management P32 1 h
UniD, n=8 5 h 27 min
Dean, Head of Department, Financial Accounting P33 52 min
Research and Teaching Assistant, Department of Financial Accounting P34 34 min
Assistant Professor, Department of Accounting P35 51 min
Assistant Professor, Department of Management Process P36 25 min
Assistant Professor, Department of Financial Markets P37 39 min
Head of Department, Accounting P38 44 min
Associate Professor, Financial Accounting P39 35 min
Associate Professor, Department of Corporate Finance P40 47 min
Archival data
List of archival and organisational documents analysed
University regulations
Rector’s directives
Minutes of Senate
Minutes of Rector’s meetings
Accreditation reports
Committee meetings minutes
PowerPoint slides from Senate’s meetings
Online sources
The PAC rankings
Official university websites

List of abbreviations

CCADT Central commission for academic degrees and titles
CESU Committee for the evaluation of scientific units
ACG Assessment common group
MSHE Ministry of science and higher education
PAC Polish accreditation committee
PM Performance measurement
PMM Performance measurement and management

Appendix 1

Table AI

Appendix 2: The interview questions

The role of the performance management system:

  1. Describe the way in which the activities of researchers are currently funded within the school.

  2. Have there been any changes? Could you please describe the nature and the reasons for the changes that have taken place, as well as their consequences?

  3. Describe the way in which the school’s performance is assessed and the changes that have taken place over the last 20 years.

  4. Describe the way in which the department’s performance is assessed within the school and the changes that have taken place over the last 20 years.

  5. Describe the way in which individual performance is assessed within the school and the changes that have taken place over the last 20 years.

  6. What are the perceived objectives of the performance measurement systems within:

    • the school/department?

    • the individual level?

  7. What are the perceived reasons for the changes in the performance measurement system within:

    • the school/department?

    • the individual level?

The uses and users of the performance measurement:

  1. Who is using the performance information (e.g. target agreements, performance appraisals, performance-related pay, budgets, variance analysis) in your school?

  2. Please describe how the performance information is used in your school:

    • at the school level?

    • at the department level?

    • at the individual level?

  3. How would you describe the interest of performance information users in the use of the performance information for faculty management purposes:

    • at the school level?

    • at the department level?

    • at the individual level?

  4. Could you please mention a few factors that determine the use of performance information?

  5. Could you please point out the most important factor and rank the order of the mentioned determinants accordingly?

  6. How do the current practices of performance management ensure the provision of the relevant information for faculty management processes?

  7. Provide your opinion on the ease of the manipulation of performance information and the ways to “improve” the performance of:

    • the school/department.

    • an individual.

  8. What are the perceived consequences of the performance measurement system?

  9. Provide your opinion on, to what extent, qualitative and quantitative performance measures are used in measuring performance.

Appendix 3

Figure A1

Appendix 4

Table AII

References

Abernethy, M.A. and Bouwens, J. (2005), “Determinants of accounting innovation implementation”, Abacus, Vol. 41 No. 3, pp. 217-240.

Adams, C.A. and Larrinaga-González, C. (2007), “Engaging with organizations in pursuit of improved sustainability accounting and performance”, Accounting, Auditing & Accountability Journal, Vol. 20 No. 3, pp. 333-355.

Adler, N.J. and Harzing, A.W. (2008), “When knowledge wins: transcending the sense and nonsense of academic rankings”, Academy of Management Learning and Education, Vol. 8 No. 1, pp. 1-24.

Agostino, D. and Arnaboldi, M. (2017), “Rational and ritualistic use of key performance indicators in hybrid organizations”, Public Money and Management, Vol. 37 No. 6, pp. 409-416.

Agyemang, G. and Broadbent, J. (2015), “Management control systems and research management in universities: An empirical and conceptual exploration”, Accounting, Auditing and Accountability Journal, Vol. 29 No. 7, pp. 1018-1046.

Ahrens, T. and Khalifa, R. (2015), “The impact of regulation on management control”, Qualitative Research in Accounting & Management, Vol. 12 No. 2, pp. 106-126.

Alach, Z. (2017), “The use of performance measurement in universities”, International Journal of Public Sector Management, Vol. 30 No. 2, pp. 102-117.

Almquist, R., Grossi, G., van Helden, J. and Reichard, C. (2013), “Public sector governance and accountability”, Critical Perspectives on Accounting, Vol. 24 Nos 7/8, pp. 479-487.

Ammons, D.N. and Rivenbark, W.C. (2008), “Factors influencing the use of performance data to improve municipal service-s: evidence from the North Carolina benchmarking project”, Public Administration Review, Vol. 68 No. 2, pp. 304-318.

Ansari, S. and Euske, K.J. (1987), “Rational, rationalizing and reifying uses of accounting data in organizations”, Accounting, Organizations and Society, Vol. 12 No. 6, pp. 549-570.

Ball, A. and Craig, R. (2010), “Using neo-institutionalism to advance social and environmental accounting”, Critical Perspective on Accounting, Vol. 21 No. 4, pp. 283-293.

Baxter, J. and Chua, W.V. (2003), “Alternative management accounting research whence and whiter”, Accounting, Organizations and Society, Vol. 28 Nos 2/3, pp. 97-126.

Bedggood, R.E. and Donovan, J.D. (2011), “University performance evaluations: what are we really measuring?”, Studies in Higher Education, Vol. 37 No. 7, pp. 825-842.

Bedggood, R.E. and Pollard, R. (1999), “The uses and misuses of student opinion surveys in eight Australian universities”, Australian Journal of Education, Vol. 43 No. 2, pp. 129-141.

Behn, R.D. (2003), “Why measure performance? Different purposes require different measures”, Public Administration Review, Vol. 63 No. 5, pp. 586-606.

Boitier, M. and Rivière, A. (2013), “Freedom and responsibility for French universities: from global steering to local management”, Accounting, Auditing & Accountability Journal, Vol. 26 No. 4, pp. 616-649.

Bouckaert, G. (1993), “Measurement and meaningful management”, Public Productivity & Management Review, Vol. 17 No. 1, pp. 31-43.

Brignall, S. and Modell, S. (2000), “An institutional perspective on performance measurement and management in the ‘new public sector’”, Management Accounting Research, Vol. 11 No. 3, pp. 281-306.

Broadbent, J. (2011), “Discourses of control, managing the boundaries”, The British Accounting Review, Vol. 43 No. 4, pp. 264-277.

Broadbent, J. and Guthrie, J. (1992), “Changes in public sector: a review of recent alternative accounting research”, Accounting, Auditing and Accountability Journal, Vol. 5 No. 2, pp. 3-31.

Broadbent, J. and Laughlin, R. (1998), “Resisting the new public management: absorption and absorbing groups in schools and GP practices in the UK”, Accounting, Auditing and Accountability Journal, Vol. 11 No. 4, pp. 403-435.

Broadbent, J. and Laughlin, R. (2009), “Performance management systems: a conceptual model”, Management Accounting Research, Vol. 20 No. 4, pp. 283-295.

Broadbent, J., Gallop, C. and Laughlin, R. (2010), “Analysing societal regulatory control systems with specific reference to higher education in England”, Accounting, Auditing and Accountability Journal, Vol. 23 No. 4, pp. 506-531.

Broadbent, J., Jacobs, K. and Laughlin, R. (2001), “Organizational resistance strategies to unwanted accounting and finance changes”, Accounting, Auditing and Accountability Journal, Vol. 14 No. 5, pp. 565-586.

Brookfield, S.D. and Preskill, S. (1999), Discussion As a Way of Teaching: Tools and Techniques for University Teachers, SRHE and Open University Press, Buckingham.

Brooks, R.L. (2005), “Measuring university quality”, The Review of Higher Education, Vol. 29 No. 1, pp. 1-21.

Burchell, S., Club, C., Hopwood, A., Hughes, J. and Nahapiet, J. (1980), “The roles of accounting in organizations and society”, Accounting, Organizations and Society, Vol. 5 No. 1, pp. 5-27.

Cai, Y. and Mehari, Y. (2015), “The use of institutional theory in higher education research”, in Huisman, J. and Tight, M. (Eds), Theory and Method in Higher Education Research, Emerald Group Publishing, Bingley, pp. 1-25.

Carruthers, B.G. (1995), “Accounting, ambiguity and the new institutionalism”, Accounting, Organizations and Society, Vol. 20 No. 4, pp. 313-328.

Cavalluzzo, K.S. and Ittner, C.D. (2004), “Implementing performance measurement innovations: evidence from government”, Accounting, Organizations and Society, Vol. 29 Nos 3/4, pp. 243-267.

Chenhall, R.H. (2003), “Management control systems design within its organizational context: findings from contingency-based research and directions for the future”, Accounting, Organizations and Society, Vol. 28 Nos 2/3, pp. 127-168.

Chenhall, R.H., Hall, M. and Smith, D. (2010), “Social capital and management control systems: a study of a non-government organization”, Accounting, Organizations and Society, Vol. 35 No. 8, pp. 737-756.

Coy, D. and Pratt, M. (1998), “An insight into accountability and politics of the universities: a case study”, Accounting, Auditing and Accountability Journal, Vol. 11 No. 5, pp. 540-561.

Craig, T.A. (1995), “Student satisfaction measurement (SSM) in Ontario universities as perceived by student service-s leaders and others”, College Student Journal, Vol. 29 No. 3, pp. 430-437.

Czarniawska, B. and Genell, K. (2002), “Gone shopping? Universities on their way to the market”, Scandinavian Journal of Management, Vol. 18 No. 4, pp. 455-474.

Czarniawska-Joerges, B. and Jacobsson, B. (1989), “Budget in a cold climate”, Accounting, Organizations and Society, Vol. 14 Nos 1/2, pp. 29-39.

De Bruijn, H. (2002), “Performance measurement in the public sector: strategies to cope with the risks of performance measurement”, The International Journal of Public Sector Management, Vol. 15 Nos 6/7, pp. 578-594.

Dill, D.D. and Soo, M. (2005), “Academic quality, league tables, and public policy: a cross-national analysis of university ranking systems”, Higher Education, Vol. 49 No. 4, pp. 495-533.

DiMaggio, P.J. and Powell, W.W. (1983), “The iron cage revisited: Institutional isomorphism and collective rationality in organizational fields”, American Sociological Review, Vol. 48 No. 2, pp. 147-160.

DiMaggio, P.J. and Powell, W.W. (1991), Introduction, the New Institutionalism in Organizational Analysis, The University of Chicago Press, Chicago, IL.

Dobija, D. and Hałas-Dej, S. (2017), “Higher education in management: the case of Poland”, in Dameron, S. and Durand, T. (Eds), The Future of Management Education, Vol. 1, Challenges facing Business Schools around the World, Palgrave Macmillan, London, pp. 277-295.

Eisenhardt, K.M. (1989), “Building theories from case study research, academy of management”, The Academy of Management Review, Vol. 14 No. 3, pp. 532-550.

Elliott, C.J. and Goh, S.C. (2013), “Does accreditation promote organizational learning? A multiple case study of Canadian university business schools”, Journal of Management Development, Vol. 32 No. 7, pp. 737-755.

Ferlie, E., Pettigrew, A., Ashburner, L. and Fitzgerald, L. (1996), The New Public Management in Action, Oxford University Press, Oxford.

Ferreira, A. and Otley, D. (2009), “The design and use of performance management systems: an extended framework for analysis”, Management Accounting Research, Vol. 20 No. 4, pp. 263-282.

Gephart, R.P. (2004), “Qualitative research and the academy of management journal”, Academy of Management Journal, Vol. 47 No. 4, pp. 454-462.

Giddens, A. (1971), Capitalism and Modern Social Theory. An Analysis of the Writings of Marx, Durkheim and Max Weber, Cambridge University Press, Cambridge.

Greenwood, R. and Hinings, C.R. (1996), “Understanding radical organizational change: bringing together the old and the new institutionalism”, The Academy of Management Review, Vol. 21 No. 4, pp. 1022-1054.

Grossi, G., Reichard, C. and Ruggiero, P. (2016), “Appropriateness and use of PI in the budgeting process: some experiences from German and Italian municipalities”, Public Performance & Management Review, Vol. 39 No. 3, pp. 581-606.

Guthrie, J. and Neumann, R. (2007), “Economic and non-financial performance indicators in universities: the establishment of a performance-driven system for Australian higher education”, Public Management Review, Vol. 9 No. 2, pp. 231-252.

Hammerschmid, G., Van de Walle, S. and Stimac, V. (2013), “Internal and external use of PI in public organisations: results from an international survey”, Public Money and Management Journal, Vol. 33 No. 4, pp. 261-268.

Harnash-Glezer, M. and Meyer, J. (1991), “Dimensions of satisfaction with college education”, Assessment & Evaluation in Higher Education, Vol. 16 No. 2, pp. 95-107.

Harun, H., Van Peursem, K. and Eggleton, I. (2012), “Institutionalization of accrual accounting in the Indonesian public sector”, Journal of Accounting & Organizational Change, Vol. 8 No. 3, pp. 257-285.

Holten, R.J. and Turner, B.S. (1989), Max Weber on Economy and Society, Routledge, London.

Hood, C. (1995), “The ‘new public management’ in the 1980s: variations on a theme”, Accounting Organizations and Society, Vol. 20 Nos 2/3, pp. 93-109.

Hoque, Z. (2005), “Securing institutional legitimacy or organizational effectiveness? A case examining the impact of public sector reform initiatives in an Australian local authority”, International Journal of Public Sector Management, Vol. 18 No. 4, pp. 367-382.

Hoque, Z., Arends, S. and Alexander, R. (2004), “Policing the police service-: a case study of the rise of ‘new public management’ within Australian police service”, Accounting, Auditing & Accountability Journal, Vol. 17 No. 1, pp. 59-84.

Jansen, E.P. (2008), “New public management: perspectives on performance and the use of PI”, Financial Accountability & Management, Vol. 24 No. 2, pp. 169-191.

Johnsen, Á. (2005), “What does 25 years of experience tell us about the state of performance measurement in public policy and management?”, Public Money & Management, Vol. 25 No. 1, pp. 9-17.

Kallio, K.M. and Kallio, T.J. (2014), “Management-by-results and performance measurement in universities – implications for work motivation”, Studies in Higher Education, Vol. 39 No. 4, pp. 574-589.

Kleiner, B.H. (1989), “Viewpoint: student evaluation of instruction”, Journal of European Industrial Training, Vol. 13 No. 6, pp. 16-17.

Kroll, A. (2014), “Why performance use varies among public managers: testing manager-related explanations”, International Public Management Journal, Vol. 17 No. 2, pp. 174-201.

Kroll, A. (2015), “Drivers of PI use: systematic literature review and directions for future research”, Public Performance & Management Review, Vol. 38 No. 3, pp. 459-486.

Lapsley, I. (1999), “Accounting and the new public management: instrument of substantive efficiently or a rationalizing modernity?”, Financial Accountability and Management, Vol. 15 Nos 3/4, pp. 201-207.

Lapsley, I. and Pettigrew, A. (1994), “Meeting the challenge: accounting for change”, Financial Accountability and Management, Vol. 10 No. 2, pp. 79-92.

Law on Academic Degrees and Title (2003), “Act of 14 March 2003 law on academic degrees and title and degrees and title in the arts”, Official Journal of Laws of 2003, No. 65, item 595, as amended.

Law on Higher Education (2005), “Act of 27 July 2005 law on higher education”, Official Journal of Laws of 2005, No. 164, item 1365, as amended.

Law on the Criteria and Procedure for Awarding Scientific Units (2016), “Ordinance of science and higher education ministry of 12 December 2016 on the criteria and procedure for awarding scientific units”, Official Journal of Laws of 2016, Item 2154.

Law on the Principles of Financing Science (2010), “Act of 30 April 2010 on the principles of financing science”, Official Journal of Laws of 2010, Nos 96/2010, Item 615.

Lee, J. (2008), “Preparing performance information in the public sector: an Australian perspective”, Financial Accountability and Management, Vol. 24 No. 2, pp. 117-149.

Lewis, J.M. (2014), “Research productivity and research system attitudes”, Public Money & Management, Vol. 34 No. 6, pp. 417-424.

Liguori, M. and Steccolini, I. (2014), “Accounting, innovation and public-sector change: translating reforms into change?”, Critical Perspectives on Accounting, Vol. 25 Nos 4/5, pp. 319-323.

Lukka, K. (2010), “Introduction: the roles and effects of paradigms in accounting research”, Management Accounting Research, Vol. 21 No. 2, pp. 110-115.

Lutz, F.W. and Field, R.W. (1998), “Business valuing in academia: the American university as a centre for profit or inquiry?”, Higher Education, Vol. 36 No. 4, pp. 383-419.

Macdonald, S. and Kam, J. (2007), “Ring a ring o’ roses: quality journals and gamesmanship in management studies”, Journal of Management Studies, Vol. 44 No. 4, pp. 640-655.

Macdonald, S. and Kam, J. (2009), “Publishing in top journals – a never-ending fad?”, Scandinavian Journal of Management, Vol. 25 No. 2, pp. 221-224.

Macdonald, S. and Kam, J. (2011), “The skewed few: people and papers of quality in management studies”, Organization, Vol. 18 No. 4, pp. 467-475.

Martin-Sardesai, A., Irvine, H., Tooley, S. and Guthrie, J. (2017), “Organizational change in an Australian university: responses to a research assessment exercise”, The British Accounting Review, Vol. 49 No. 4, pp. 399-412.

Melkers, J. and Willoughby, K. (2005), “Models of performance-measurement use in local governments: understanding budgeting, communication, and lasting effects”, Public Administration Review, Vol. 65 No. 2, pp. 180-190.

Melo, A.I., Sarrico, C.S. and Radnor, Z. (2010), “The influence of performance measurement systems in universities: the case of an English university”, Public Management Review, Vol. 12 No. 2, pp. 233-254.

Meyer, J.W. and Rowan, B. (1977), “Institutionalized organizations: formal structure as myth and ceremony”, American Journal of Sociology, Vol. 83 No. 2, pp. 340-363.

Mimba, N.P., van Helden, G.J. and Tillema, S. (2013), “The design and use of PI in Indonesian local governments under diverging stakeholder pressures”, Public Administration and Development, Vol. 33 No. 1, pp. 15-28.

Mingers, J. and Willmott, H. (2013), “Taylorizing business school research: on the ‘one best way’ performative effects of journal ranking lists”, Human Relations, Vol. 66 No. 8, pp. 1051-1073.

Modell, S. (2001), “Performance measurement and institutional processes: a study of managerial responses to public sector reform”, Management Accounting Research, Vol. 12 No. 4, pp. 437-464.

Modell, S. (2003), “Goals versus institutions: the development of performance measurement in the Swedish university sector”, Management Accounting Research, Vol. 14 No. 4, pp. 333-359.

Moll, J. and Hoque, Z. (2011), “Budgeting for legitimacy: the case of an Australian university”, Accounting, Organizations and Society, Vol. 36 No. 2, pp. 86-101.

Mouritsen, J. (1994), “Rationality, institutions and decision-making: reflections on March and Olsen’s rediscovering institutions”, Accounting, Organisations and Society, Vol. 19 No. 2, pp. 193-211.

Moynihan, D.P. (2016), “Political use of performance data”, Public Money & Management, Vol. 36 No. 7, pp. 479-481.

Moynihan, D.P. and Landuyt, N. (2009), “How do public organizations learn? Bridging cultural and structural perspectives”, Public Administration Review, Vol. 69 No. 6, pp. 1097-1105.

Moynihan, D.P. and Pandey, S.K. (2010), “The big question for performance management: why do managers use PI?”, Journal of Public Administration Research and Theory, Vol. 20 No. 4, pp. 849-866.

Najeeb, A. (2013), “Institutional perspectives in HRM and MNC research: a review of key concepts”, International Journal of Employment Studies, Vol. 21 No. 2, pp. 79-100.

Najeeb, A. (2014), “Institutional theory and human resource management”, in Hasan, H. (Ed.), Being Practical with Theory: A Window into Business Research, THEORI, Wollongong, pp. 25-30.

Narayan, A., Northcott, D. and Parker, L.D. (2017), “Managing the accountability-autonomy tensions in university research commercialisation”, Financial Accountability & Management, Vol. 33 No. 4, pp. 335-355.

Odzil, E. and Hoque, S. (2017), “Budgetary change at a university: a narrative inquiry”, British Accounting Review, Vol. 49 No. 3, pp. 316-328.

Osborne, D. and Gaebler, T. (1993), Reinventing Government: How the Entrepreneurial Spirit is Transforming the Public Sector, Addison-Wesley Publishing Company, Reading, MA.

Osterloh, M. (2010), “Governance by numbers: does it really work in research?”, Analyse und Kritik, Vol. 32 No. 2, pp. 267-283.

Otley, D. (2003), “Management control and performance management: whence and whither?”, The British Accounting Review, Vol. 35 No. 1, pp. 309-326.

Otley, D. (2016), “The contingency theory of management accounting and control: 1980-2014”, Management Accounting Research, Vol. 31 No. 1, pp. 45-62.

Paauwe, J. and Boselie, P. (2003), “Challenging ‘strategic HRM’ and the relevance of the institutional setting”, Human Resource Management Journal, Vol. 13 No. 3, pp. 56-70.

Parker, L. (2011), “University corporatisation: driving redefinition”, Critical Perspectives on Accounting, Vol. 22 No. 4, pp. 434-450.

Parker, L., Guthrie, J. and Gray, R. (1998), “Accounting and management research: passwords from the gatekeepers”, Accounting, Auditing & Accountability Journal, Vol. 11 No. 4, pp. 371-406.

Pettersen, I.J. (2015), “From metrics to knowledge? Quality assessment in higher education”, Financial Accountability and Management, Vol. 31 No. 1, pp. 23-40.

Pettigrew, A.M. (1990), “Longitudinal field research on change: theory and practice”, Organization Science, Vol. 1 No. 3, pp. 267-292.

Pollitt, C. (2002), “Clarifying convergence: Striking similarities and durable differences in public management reform”, Public Management Review, Vol. 4 No. 1, pp. 471-492.

Pollitt, C. (2006), “PI for democracy: the missing link?”, Evaluation, Vol. 12 No. 1, pp. 38-55.

Pop-Vasileva, A., Baird, K. and Blair, B. (2011), “University corporatisation: the effect on academic work-related issues”, Accounting, Auditing and Accountability Journal, Vol. 24 No. 4, pp. 402-439.

Powell, W.W. (1991), “Expanding the scope of institutional analysis”, in Powell, W.W. and DiMaggio, P.J. (Eds), New Institutionalism in Organizational Analysis, University of Chicago Press, Chicago, IL, pp. 183-203.

Putnam, R., Leonardi, R. and Nantetti, R. (1993), Making Democracy Work: Civic Traditions in Modern Italy, Princeton University Press, Princeton, NJ.

Ramirez, O. (2006), “Growing commonalities and persistent differences in higher education: universities between globalisation and national tradition”, in Mayer, H.D. and Rowan, B. (Eds), The New Institutionalism in Education: Advancing Research and Policy, SUNY Press, Albany, NY, pp. 124-141.

Ramsden, P. (1990), “Evaluating teaching: supporting learning”, in Ross, B. (Ed.), Proceedings of the 16th Annual Conference of HERDSA in Teaching for Effective Learning, HERDSA, Brisbane, pp. 27-42.

Ryazanova, O. and McNamara, P. (2016), “Socialization and proactive behavior: multilevel exploration of research productivity drivers in US business schools”, Academy of Management Learning & Education, Vol. 15 No. 3, pp. 525-548.

Saliterer, I. and Korac, S. (2013), “PI use by politicians and public managers for internal control and external accountability purposes”, Critical Perspectives on Accounting, Vol. 24 Nos 7/8, pp. 502-517.

Schriewer, J. (2009), “Rationalized myths’ in European higher education – the construction and diffusion of the Bologna system”, European Education, Vol. 41 No. 2, pp. 31-51.

Sohail, M.S. and Saeed, M. (2003), “Private higher education in Malaysia: Students’ satisfaction levels and strategic implications”, Journal of Higher Education Policy and Management, Vol. 25 No. 2, pp. 173-181.

Taylor, J. (2007), “The usefulness of key performance indicators to public accountability authorities in East Asia”, Public Administration and Development, Vol. 27 No. 4, pp. 341-352.

Taylor, J. (2009), “Strengthening the link between performance measurement and decision-making”, Public Administration, Vol. 87 No. 4, pp. 853-871.

ter Bogt, H. and Scapens, R. (2012), “Performance management in universities: effects of the transition to more quantitative measurement systems”, European Accounting Review, Vol. 21 No. 3, pp. 451-497.

ter Bogt, H.J. and van Helden, G.J. (2000), “Accounting change in Dutch government: exploring the gap between expectations and realizations”, Management Accounting Research, Vol. 11 No. 2, pp. 263-279.

Tourish, D. and Willmott, H. (2015), “In defiance of folly: journal rankings, mindless measures and the ABS guide”, Critical Perspectives on Accounting, Vol. 26 No. 1, pp. 37-46.

Townley, B. (1997), “The institutional logic of performance appraisal”, Organization Studies, Vol. 18 No. 2, pp. 261-285.

Tucker, B.P. and Parker, L.D. (2015), “Business as usual? An institutional view of the relationship between management control systems and strategy”, Financial Accountability & Management, Vol. 31 No. 2, pp. 113-149.

Van Dooren, W. and Thijs, N. (2010), “Paradoxes of improving performance management (systems) in public administration”, EIPA Scope, Vol. 2010 No. 2, pp. 13-18.

Van Dooren, W., Bouckaert, G. and Halligan, J. (2010), Performance Management in the Public Sector, Routledge, London and New York, NY.

Van Gestel, N. and Teelken, C. (2006), “Neo-institutional perspectives on public management reform”, Management International, Vol. 10 No. 3, pp. 99-109.

Van Helden, G.J. and Reichard, C. (2013), “A meta-review of public sector performance management research”, Tékhne, Vol. 11 No. 1, pp. 10-20.

Van Helden, J., Argento, D., Caperchione, E. and Caruana, J. (2016), “Editorial: politicians and accounting information – a marriage of convenience?”, Public Money & Management, Vol. 36 No. 7, pp. 473-476.

Verbeeten, F.H.M. (2008), “Performance management practices in public sector organizations: impact on performance”, Accounting, Auditing & Accountability Journal, Vol. 21 No. 3, pp. 427-454.

Walker, R., Damanpour, F. and Devece, C. (2011), “Management innovation and organizational performance: the mediating effect of performance management”, Journal of Public Administration Research and Theory, Vol. 21 No. 2, pp. 367-386.

Ware, J.E. and Williams, R.G. (1980), “A reanalysis of the doctor fox experiments”, Instructional Evaluation, Vol. 4, pp. 15-18.

Willmott, H. (1995), “Managing the academics: commodification and control in the development of university education in the UK”, Human Relations, Vol. 48 No. 9, pp. 993-1027.

Willmott, H. (2011), “Journal list fetishism and the perversion of scholarship: reactivity and the ABS list”, Organization, Vol. 18 No. 4, pp. 429-442.

Yorke, M. and Longden, B. (2004), Retention and Student Success in Higher Education, Open University Press, Maidenhead.

Acknowledgements

This project is financed by National Science Center, Poland (Grant No. 2015/19/B/HS4/02903).

This paper forms part of a special section “Accountability and performance challenges in knowledge intensive public organisations”.

Corresponding author

Dorota Dobija can be contacted at: dobija@kozminski.edu.pl

Related articles