Search results

The purpose of this paper is to describe a range of innovative (for public library performance measurement and impact assessment) methods and tools developed by country teams as part of the Global Libraries (GL) initiative. Short reports are provided on: a return on investment study, a simplified data processing system for library managers and an online reporting system for public libraries in Ukraine; a study of the public image of Polish libraries in print mass media, two approaches to sustainability of performance measurement and impact assessment in Romania, through tools to conduct pop-up surveys and use of agricultural subsidies support data, assessments of changes in public library managers’ planning efforts in Poland and of their perceptions of libraries and their own role, using Modified Delphi forecasting, in Lithuania, two ways of focussing on the world of public library users by engaging non-profit organizations in library research in Poland and conducting impact studies in virtual environments in Chile.

A range of methods and tools and their uses are described.

No specific research findings are reported.

All of these tools and methods have been (or are being) trialed in national public library contexts; some have been developed over several years.

Useful for people in other (non-GL) countries who may be contemplating public library evaluation at regional, national or local level or who are interested in performance measurement and impact evaluation.

This paper is part of a GL effort to share what participants have learnt about impact planning and assessment in public libraries with the wider international libraries community.

The impact planning and assessment program of GL has been the largest sustained international public library evaluation program so far attempted. This paper reports on the more innovative evaluation activities undertaken at country level through this program.

Amidst the scarcity of resources, it is undisputable that an effective public procurement performance measurement system (PMS) is required particularly in county governments, especially for Kenya to realize its ambitions in devolved governance system. County governments cannot be effectively evaluated on their performance if the long-term, strategic impact of public procurement processes and projects is not captured. Arising from this backdrop, this study aims to determine the predictors of strategic procurement performance metrics (SPPM) adoption in public procurement PMS of county governments.

Anchored on institutional theory and public sector scorecard model, a survey research design was adopted where data were collected through census from 115 respondents working in procurement, finance and stores department of Kakamega county government. Data were collected using questionnaire (75.56% response rate) and key informant interviews, and analyzed by using multiple regression model and ordinal logistic regression models.

Multiple regression model and ordinal logistics regression revealed that national government support negatively and significantly, and regulatory framework positively and significantly affects the adoption of SPPM.

There is need for formal mechanism that will enable the national government in partnership with the council of governors to be proactively involved in developing procurement performance measurement capacity of county governments. This study’s findings also provide suggestions for a working regulatory framework required for the adoption of SPPM by county governments.

This work adds value to the prevailing body of knowledge on public procurement PMS in the public sector.

The purpose of this paper is to report on performance measurement and impact assessment progress made in 14 countries as part of the Global Libraries initiative, starting with the early country grants in Mexico and Chile. For the mature grants in Bulgaria, Botswana, Poland, Romania, Ukraine and Viet Nam which were recently completed or are approaching completion, the nature of the country program is outlined, before the impact assessment work is described and some recent results and conclusions are reported. A similar approach is adopted with pilot and new grants in Colombia, Indonesia, South Africa, Turkey and Lithuania.

The country reports are presented as a series of case studies, in some cases supplementing those in an earlier special issue of this journal.

Where appropriate, recent country-specific survey findings are reported.

This paper shares Global Libraries IPA learning at country level with people in other countries who may be contemplating public library evaluation at regional, national or local level or who are interested in performance measurement and impact evaluation.

These cases studies reflect concentrated impact assessment and performance measurement work at country level across a range of countries over more than 12 years.

This paper aims to present a summary of the performance measurement and evaluation plan of the Wyoming connected vehicle (CV) Pilot Deployment Program (WYDOT Pilot).

This paper identified 21 specific performance measures as well as approaches to measure the benefits of the WYDOT Pilot. An overview of the expected challenges that might introduce confounding factors to the evaluation effort was outlined in the performance management plan to guide the collection of system performance data.

This paper presented the data collection approaches and analytical methods that have been established for the real-life deployment of the WYDOT CV applications. Five methodologies for assessing 21 specific performance measures contained within eight performance categories for the operational and safety-related aspects. Analyses were conducted on data collected during the baseline period, and pre-deployment conditions were established for 1 performance measures. Additionally, microsimulation modeling was recommended to aid in evaluating the mobility and safety benefits of the WYDOT CV system, particularly when evaluating system performance under various CV penetration rates and/or CV strategies.

The proposed performance evaluation framework can guide other researchers and practitioners identifying the best performance measures and evaluation methodologies when conducting similar research activities.

To the best of the authors’ knowledge, this is the first research that develops performance measures and evaluation plan for low-volume rural freeway CV system under adverse weather conditions. This paper raised some early insights into how CV technology might achieve the goal of improving safety and mobility and has the potential to guide similar research activities conducted by other agencies.

Measurement of the innovation process performance is critical for both managers and researchers. However, existing performance frameworks (PFs) neglect performance indicators (PIs) and dimensions relevant to the current innovation landscape in companies as well as lack support in the definition of action plans. Thus, this paper aims to introduce a new and updated PF for measuring innovation performance and defining improvement actions.

The proposed PF is developed from literature and action-oriented case studies in two European manufacturing companies. First, the literature review enabled the synthesis of framework elements into a “conceptual” PF capable of illustrating the current state of knowledge in the field. Then, this PF was applied in the case studies that enriched the conceptual form with empirical insights, resulting in a new and updated PF.

The review enabled the systematisation of nine dimensions and 259 PIs that were fragmented throughout the literature. In turn, empirical insights from the case studies gave rise to an actionable procedure for providing a comprehensive diagnosis of the company's situation considering the new trends as well as defining improvement actions. Although the results from the two cases cannot be generalised, the findings encourage broader applicability.

The novelty of this research resides on the fact that the PF consolidates elements from the literature but combined with empirical insights in a new actionable way that supports managers in performance measurement and provides researchers with an extensive systematisation of dimensions and PIs.

The purpose of this study is to identify, characterize and assess supplier flexibility measurement practices in the order-to-delivery process.

The study involved a survey; participants were 224 purchasing managers at Swedish manufacturing companies that had more than 20 employees.

Scrutiny of the details of measurement practices revealed that most respondents actually do not specifically measure supplier flexibility. Instead they measure other measures like delivery reliability, conduct qualitative follow-ups, or cannot specify how supplier flexibility is measured. It was acknowledged that they measure different supplier flexibility aspects, and the applied measures were characterized, e.g. in terms of which flexibility dimension they represent.

Conceptual clarifications and adaptations to measuring supplier flexibility in the order-to-delivery process are provided. The identified measures can be a contribution in further developing literature on flexibility performance measurement.

Purchasing, logistics and supply chain managers in search of supplier flexibility performance measurement can find ways to measure and an extended flexibility vocabulary. This has the potential to improve flexibility in the supply chain.

Even though flexibility is claimed as being an important competitive advantage, few empirical studies and operationalized measures exist, particularly in the order-to-delivery process.

The purpose of this paper is to develop a theoretical model elaborating on the type of conditions that can inhibit (or at least temporarily hold back) “reactive conformance” in the wake of an increasing reliance on quantitative performance evaluations of academic research and researchers.

A qualitative study of a research group at a Swedish university who was recurrently exposed to quantitative performance evaluations of their research activities.

The empirical findings show how the research group under study exhibited a surprisingly high level of non-compliance and non-conformity in relation to what was deemed important and legitimate by the prevailing performance evaluations. Based on this, we identify four important qualities of pre-existing research/er ideals that seem to make them particularly resilient to an infiltration of an “academic performer ideal,” namely that they are (1) central and since-long established, (2) orthogonal to (i.e. very different from) the academic performer ideal as materialized by the performance measurement system, (3) largely shared within the research group and (4) externally legitimate. The premise is that these qualities form an important basis and motivation for not only criticizing, but also contesting, the academic performer ideal.

Extant research generally finds that the proliferation of quantitatively oriented performance evaluations within academia makes researchers adopt a new type of academic performer ideal which promotes research conformity and superficiality. This study draws upon, and adds to, an emerging literature that has begun to problematize this “reactive conformance-thesis” through identifying four qualities of pre-existing research/er ideals that can inhibit (or at least temporarily hold back) such “reactive research conformance.”