Search results

The purpose of this paper is to discuss emerging practices in open evaluation, namely, the concept of co-evaluation and how research on evaluation developed within information science can contribute to enhance stakeholders and citizens’ involvement in open science.

A meta-evaluative and transdisciplinary approach – directed toward the intersection between information science, evaluation, competences management, sustainability transitions management and participatory methodologies – provided the basis for the identification and subsequent reflection on the levels of stakeholder participation embedded into ISO 16439’s (2014) methods for assessing the impact of libraries and on the domains and competences to be mobilized for (co)evaluation. The contributions of Engaged 2020 Action Catalogue, as well as several taxonomies of evaluator competences and the Council of Europe’s (2016) conceptual model of competences for a democratic culture were particularly relevant for this (re)construction process.

Two results of the line of research carried out since 2012 at the Faculty of Social Sciences and Humanities of the Universidade NOVA de Lisboa (Portugal) can significantly contribute to improve stakeholders’ participation in Open Science: ISO 16439’s systematization of methods and procedures for assessing the impact of libraries and the (co-)evaluation competency framework.

This paper presents the transdisciplinary concept of co-evaluation and examines the current epistemological challenges to science by analyzing the general tendency to openness through the lens of research on evaluation and participatory methods developed within information science.

The purpose of this paper is to characterize performance evaluation dynamics developed in Lisbon Municipal Libraries Network (LMLN) over a two-decade period (1989-2009), using a specific model and tools of (meta-)analysis.

Based on a methodology eminently qualitative supported by a combination of research methods (literature review, construction and application of conceptual models for analysis and case study), the author examined LMLN's performance evaluation progress, focusing on the diachronic study of evaluative processes – the performance evaluation dynamics.

Between 1989 and 2009, LMLN developed four main performance evaluation dynamics. The most significant results that emerged from the examination of these dynamics relate to the following elements of the model of analysis Dynamics and Impacts of Library Performance Evaluation (DILPE): evaluation objects and methods; organization; and dissemination of results. The study also emphasized the importance of some factors to dynamics sustainability: the presence of a permanent coordination team, in the direct dependency of the head of library services, with the right competences; the existence of a culture of assessment; and the commitment of leadership with performance evaluation.

The meta-evaluative approach and particularly the focus on the long-term development of evaluative theories and practices, contributes to the enlargement of the international corpus on library performance evaluation. On the other hand, the analytical model and conceptual tools created might be useful to other researchers/practitioners willing to meta-evaluate library performance evaluation dynamics.

This paper aims to deepen the concept of service quality in digital libraries based on the analysis of the Digital Library Service Quality Model (adapted from Zeithaml, Parasuraman and Malhotra) and a multiple‐item scale (dlQUAL scale) created to evaluate the quality and performance of service delivered by the Portuguese Digital Library Consortium as part of the Digital Library Integrated Evaluation Programme.

The Digital Library Service Quality Model makes it possible to assess gaps between different levels based on a multiple‐item scale to evaluate service quality, which was designed as a web survey. Considering the strategical groups (users, LIS professionals, library managers and top managers), the research team developed four different web‐survey versions to evaluate the different gaps. In the first step of this study, they looked for measures validity.

The scale proved good psychometric proprieties. This study also showed the usefulness of the Digital Library Service Quality Model to evaluate and analyze digital libraries' service quality.

The scale is valid and useful to evaluate digital libraries' service quality and it can provide valuable performance information to digital libraries' decision‐makers. Moreover, the Digital Library Service Quality Model is a useful instrument to check the critical points that are related to organizational deficiencies. If these gaps are regularly monitored, it is possible to implement adequate correction measures and improve service quality.

This paper presents a Library Service Quality Model specifically designed to evaluate digital libraries.