Search results
1 – 10 of over 65000David S. Bedford, Markus Granlund and Kari Lukka
The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of…
Abstract
Purpose
The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of research quality is becoming too simplistically and narrowly determined by research quality's measurable proxies and that academics, especially manager-academics, do not sufficiently realise this risk. Whilst prior literature has covered the effects of performance measurement in the university sector broadly and how PMSs are mobilised locally, there is only little understanding of whether and how PMSs affect the meaning of research quality in practice.
Design/methodology/approach
The study is designed as a comparative case study of two university faculties in Finland. The role of conceptual analysis plays a notable role in the study, too.
Findings
The authors find that manager-academics of the two examined faculties have rather similar conceptual understandings of research quality. However, there were differences in the degree of slippage between the “espoused-meaning” of research quality and “meaning-in-practice” of research quality. The authors traced these differences to how the local PMS and manager-academics’ agency relate to one another within the context of increasing global and national performance pressures. The authors developed a tentative framework for the various “styles of agency”. This suggests how the relationship between the local PMS and manager-academics’ exerted agency shapes the “degrees of freedom” of the meaning of research quality in practice.
Originality/value
Given that research quality lies at the heart of academic work, the authors' paper indicates that exploring the three matters – performance measurement, the agency of manager-academics and the meaning of research quality in practice – in combination is crucial for the sustainability of the academe. The authors contribute to the literature by detailing the way in which local PMS and manager-academics' agency have material impacts on what research quality means in practice. The authors conclude by highlighting the pressing need for manager-academics to exercise the agency in efforts to safeguard a broad and pluralistic understanding of research quality in practice.
Details
Keywords
Enrico Guarini, Francesca Magli and Andrea Francesconi
The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to…
Abstract
Purpose
The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to shed light on how external pressures related to measurement of research performance are translated into organisational and individual academic responses within the university and the extent to which these responses are related specifically to the operational features of performance measurement systems (PMS).
Design/methodology/approach
The study is based on a case study conducted in an Italian public university and based on interviews with a cross-disciplinary sample of faculty members.
Findings
The study provides insights into how linking financial incentives and career progression to research performance metrics at the system and organisational levels may have important reorientation effects on individual behaviours and epistemic consequences for the academic work.
Research limitations/implications
The study is based on interviews, so one limitation is related to the risk of researcher and interviewee personal bias. Moreover, this study is focused on one single case of a specific university setting, which cannot be fully representative of the experiences of others.
Originality/value
The study contributes to the literature on management accounting by exploring the factors that might explain why the unintended effects of PMS on academics’ behaviour reported by several studies might occur. From a practitioner’s point of view, it shows features of PMS that may produce unintended effects on academic activities. It also highlights the need to rethink PMS for the evaluation of university performance through the involvement of different stakeholders.
Details
Keywords
Mary A. Malina and Basil P. Tucker
Purpose – The authors investigate the interpretations of senior university decision-makers on three questions: (1) What constitutes “relevant” research? (2) In what ways is the…
Abstract
Purpose – The authors investigate the interpretations of senior university decision-makers on three questions: (1) What constitutes “relevant” research? (2) In what ways is the relevance of research typically measured? and (3) What alternative ways might be adopted in measuring the relevance of research?
Design/methodology/approach – This exploratory study adopts an inductive approach, informed by data collected from semi-structured interviews with senior research-related university leaders and archival sources in five Australian and eight US universities.
Findings – There is considerable convergence in the conceptualization as well as the operationalization of the notion of relevance between the Australian and US universities participating in this study. The evidence supports a relational rather than currently prevailing transactional approaches in operationalizing the concept of research relevance. This relational approach emphasizes the importance of stakeholders, their needs and expectations, and their engagement in the articulation of measures that demonstrate the relevance of research in both the short and longer terms.
Research limitations/implications – The evidence is primarily based on the views of university senior management drawn from a relatively small number of universities leading to questions about the representativeness and generalizability of the findings. Moreover, the findings have been informed by leaders at the most senior hierarchical levels. Although consistent with the aim of the study, the views of university leaders provide only one view on our research questions.
Originality/value – The authors provide a conceptual view of research relevance from the perspective of one pivotal group – university senior management – that has been largely and surprisingly overlooked in discussions of the relevance of academic research.
Details
Keywords
The purpose of this paper is to measure the competencies of libraries in Nigerian universities, identify constraints to their performance and recommend infrastructures and…
Abstract
Purpose
The purpose of this paper is to measure the competencies of libraries in Nigerian universities, identify constraints to their performance and recommend infrastructures and competencies required. Institutional accreditation has compelled academic libraries in Nigerian to improve their quality, competencies and performances for accountability.
Design/methodology/approach
A questionnaire was the main instrument for data collection. The population of the study was all the university librarians in the 89 universities in Nigeria that the author selected from federal, state and private universities. Of the 81 sets of questionnaires emailed, 49 were returned, which represents a 60.5 per cent response rate and provides the working population of the study. Data were analysed using frequency tables, simple percentages and bar charts.
Findings
The results indicate that academic libraries and librarians in Nigeria are competent in three key areas – educational roles, professional development and research. However, they are not very effective in the provision and use of library resources in cyberspace, adequate funding, collection development and information technology skills. The main constraints are: poor Internet penetration, low bandwidth, unreliable power supply and weak Internet proficiency. This paper suggests that adequate funding, benchmark performance and multi-skilling can serve as strategies against these constraints in developing regions.
Practical implications
This study contributes to library staff assessment because it links strategic objectives to performance measures and associated long-term targets. It broadens issues which affect sustainable performance in academic libraries in Nigeria, as well as in Africa and other developing countries.
Originality/value
While performance measurement is well established in developed countries, it is less or not so well established in Nigeria and other developing countries. The current research seeks to develop a performance measurement framework for academic libraries that is testable and expandable to Nigeria and the whole African context.
Details
Keywords
In the modern “student focused” university setting, quality assurance and continual service improvement have become more and more important in the delivery of academic library…
Abstract
Purpose
In the modern “student focused” university setting, quality assurance and continual service improvement have become more and more important in the delivery of academic library services. Working in partnership with their students, academic libraries can enable meaningful engagement, through qualitative methods which allow individual students to contribute to performance measurement activities and service development. The purpose of this paper is to discuss how qualitative methods can be used to engage students in the performance measurement activities of academic libraries.
Design/methodology/approach
Through a review of relevant literature, discussion around the main themes and some case study examples, this paper illustrates how effective student engagement through qualitative methods can contribute to the quality assurance, performance measurement and ultimate service improvement of academic libraries.
Findings
The paper focuses specifically on focus group and reflective methods and also details some elements of user experience (UX) which brings together different qualitative techniques available for academic libraries. The paper concludes with a feature case study which discusses how meaningful student engagement was achieved through a large-scale UX project at the University of the Arts, London.
Originality/value
The paper brings together many different discussions around qualitative methods in performance measurement and is original in its discussions around such activity as student engagement initiatives.
Details
Keywords
Aneta Kucińska-Landwójtowicz, Izabela Dagmara Czabak-Górska, Marcin Lorenc, Pedro Domingues and Paulo Sampaio
The main purpose of this paper is twofold: to present a proposal for a model of educational quality management system within a process approach context for technical universities…
Abstract
Purpose
The main purpose of this paper is twofold: to present a proposal for a model of educational quality management system within a process approach context for technical universities, and a conceptual model of a performance measurement system (PMS) towards the assessment of the quality level of management, core and support processes.
Design/methodology/approach
The paper encompasses two main parts: a theoretical portion and a case study. Within the theoretical background, the authors discuss the issue of educational quality management supported on a process approach perspective as well as performance measurement system in high education (HE). The case study reports the development of the concept of performance measurement system for technical universities.
Findings
The proposed system of educational quality management supported on a process approach, together with a conceptual model of the performance measurement system, can be implemented in every technical university. The identification of processes in the education quality management system permitted the development of the PMS. The model covers 32 key performance indicators (KPIs) for management processes, 39 for core processes and 19 for supporting ones.
Research limitations/implications
The proposed performance measurement system is limited in its focus on educational processes and support of these processes. The evaluation of scientific and research activity and aspects related to financial resources is not pursued.
Originality/value
Elaboration of a conceptual model of a performance measurement system towards the assessment of the quality level of management, core and support processes is dedicated to technical universities.
Details
Keywords
Kirsi-Mari Kallio, Tomi J. Kallio, Giuseppe Grossi and Janne Engblom
Employing institutional logic and institutional work as its theoretical framework, this study analyzes scholars' reactions to performance measurement systems in academia.
Abstract
Purpose
Employing institutional logic and institutional work as its theoretical framework, this study analyzes scholars' reactions to performance measurement systems in academia.
Design/methodology/approach
Large datasets were collected over time, combining both quantitative and qualitative elements. The data were gathered from a two-wave survey in 2010 (966 respondents) and 2015 (672 respondents), conducted among scholars performing teaching- and research-oriented tasks in three Finnish universities.
Findings
The analysis showed statistically significant changes over time in the ways that the respondents were positioned in three major groups influenced by different institutional logics. This study contributes to the international debate on institutional change in universities by showing that in Finnish universities, emerging business logics and existing professional logics can co-exist and be blended among a growing group of academics. The analysis of qualitative open-ended answers suggests that performance measurement systems have led to changes in institutional logic, which have influenced the scholars participating in institutional work at the microlevel in academia.
Social implications
While most scholars remain critical of performance measurement systems in universities, the fact that many academics are adapting to performance measurement systems highlights significant changes that are generally occurring in academia.
Originality/value
While most extant studies have focused on field- and organizational-level analyses, this study focuses on understanding how the adoption of performance measurement systems affects institutional logic and institutional work at the microlevel. Moreover, the study's cross-sectional research setting increases society's understanding of institutional evolution in academia.
Details
Keywords
Ann Martin-Sardesai, James Guthrie and Basil P. Tucker
This paper explores the impact of contemporary calculative practices, termed “accountingisation”, on Australian accounting academics' values. Also, it seeks to understand the…
Abstract
Purpose
This paper explores the impact of contemporary calculative practices, termed “accountingisation”, on Australian accounting academics' values. Also, it seeks to understand the rationale underlying the development of various university performance measurement systems (PMSs), and their implementation and evaluation.
Design/methodology/approach
A case study approach uses accounting academics' responses to an online survey and also semi-structured interviews with senior research-related leaders in a group of Australian universities. This is supplemented by document analysis. A narrative story-telling approach explores and presents the combined data observations, over the period 2010–2018, of two characters: a “typical” accounting academic and a “typical” vice-chancellor.
Findings
The study contributes to the literature on PMSs in understanding “accountingisation”, the rationale behind the development, implementation and evaluation of performance metrics by senior management and its impact on accounting academics. It juxtaposes and unpacks the complexities and nuances of PMSs and provides empirical evidence by highlighting the perceptions of both the Australian accounting academics and senior university management. The findings demonstrate a level of discontent among accounting academics in reconciling the expectations of increased “accountingisation” within university PMSs. These are juxtaposed against the views of senior university leaders who are influential in determining PMSs.
Originality/value
This paper is novel in considering the implications of “accountingisation” in a contemporary setting, focusing on accounting academics, values and individual PMSs within business schools.
Details
Keywords
Khalfan Zahran Al Hijji and Andrew M. Cox
The purpose of this paper is to investigate measurement methods that are in use in various aspects of academic libraries in Oman.
Abstract
Purpose
The purpose of this paper is to investigate measurement methods that are in use in various aspects of academic libraries in Oman.
Design/methodology/approach
The framework of the research was built to explore various steps of conceptualizing, collecting, analyzing data, and reporting results. Data gathered through in‐depth interviews with participants represented different management levels. The analysis process utilized content analysis to shape the relationship between categories that were subjected to formulate knowledge.
Findings
Results show that all libraries have used one method or more in evaluating the progress of their services, and the performance of their staff members. These include: surveys; reports; KPIs; statistics; and interviews, in addition to appraisal forms which are used for staff evaluation. Alongside internal evaluation by librarians, an external evaluation by OAC and other international bodies took place in some libraries.
Research limitations/implications
The research was challenged by great differences in history, size, and infrastructure between the institutions, which had affected the selection of the research population. Moreover, reports and statistics which existed in some libraries could not provide the necessary data, which forced the researcher to depend on the data gathered from respondents in building the research knowledge.
Originality/value
This study aims to fill part of the gap which exists in measurement processes of information services, as it is the first study shedding light on evaluation methods in academic libraries in Oman.
Details
Keywords
Thoah Kim Thi Ninh, Kerry Tanner, Graeme Johanson and Tom Denison
Higher education reform in Vietnam has recently required university libraries to improve their quality, to evaluate their performance, and to be accountable for the purpose of…
Abstract
Purpose
Higher education reform in Vietnam has recently required university libraries to improve their quality, to evaluate their performance, and to be accountable for the purpose of quality assessment and accreditation. Systematic performance measurement is an integral part of this process. The aims of this paper are: to provide an overview of the current state of performance development in Vietnamese university libraries; to address issues related to the measurement of library performance; and to propose an approach to evaluation for university libraries in Vietnam.
Design/methodology/approach
The paper reviews the literature on library performance measurement, with particular focus on university libraries in Vietnam. Relevant documents relating to performance measurement were examined, and two case studies of performance measurement in university libraries in Vietnam were carried out.
Findings
It is critical that university libraries in Vietnam develop systematic performance measures and apply different methods and tools for performance measurement. To succeed, cooperation between the administering authority, university administration and library management is essential.
Research limitations/implications
This paper reports on the first phase of a doctoral research project at Monash University. Further research is being undertaken to develop a framework for quality assurance and performance measurement for Vietnamese university libraries. The efficacy if this framework is yet to be tested through its deployment in practice.
Originality/value
While performance measurement is well established in Western countries, it is less so in Vietnam. The current research is seeking to develop a performance measurement framework for university libraries that is attuned to the Vietnamese context. The paper stresses the urgent need for the development of effective performance measures and systematic performance measurement systems amongst this sector.
Details