Search results

1 – 10 of 118
Article
Publication date: 4 November 2014

Leonor Gaspar Pinto

The purpose of this paper is to characterize performance evaluation dynamics developed in Lisbon Municipal Libraries Network (LMLN) over a two-decade period (1989-2009), using a…

Abstract

Purpose

The purpose of this paper is to characterize performance evaluation dynamics developed in Lisbon Municipal Libraries Network (LMLN) over a two-decade period (1989-2009), using a specific model and tools of (meta-)analysis.

Design/methodology/approach

Based on a methodology eminently qualitative supported by a combination of research methods (literature review, construction and application of conceptual models for analysis and case study), the author examined LMLN's performance evaluation progress, focusing on the diachronic study of evaluative processes – the performance evaluation dynamics.

Findings

Between 1989 and 2009, LMLN developed four main performance evaluation dynamics. The most significant results that emerged from the examination of these dynamics relate to the following elements of the model of analysis Dynamics and Impacts of Library Performance Evaluation (DILPE): evaluation objects and methods; organization; and dissemination of results. The study also emphasized the importance of some factors to dynamics sustainability: the presence of a permanent coordination team, in the direct dependency of the head of library services, with the right competences; the existence of a culture of assessment; and the commitment of leadership with performance evaluation.

Originality/value

The meta-evaluative approach and particularly the focus on the long-term development of evaluative theories and practices, contributes to the enlargement of the international corpus on library performance evaluation. On the other hand, the analytical model and conceptual tools created might be useful to other researchers/practitioners willing to meta-evaluate library performance evaluation dynamics.

Article
Publication date: 1 February 2000

Pia Borlund

This paper presents a set of basic components which constitutes the experimental setting intended for the evaluation of interactive information retrieval (IIR) systems, the aim of…

1980

Abstract

This paper presents a set of basic components which constitutes the experimental setting intended for the evaluation of interactive information retrieval (IIR) systems, the aim of which is to facilitate evaluation of IIR systems in a way which is as close as possible to realistic IR processes. The experimental setting consists of three components: (1) the involvement of potential users as test persons; (2) the application of dynamic and individual information needs; and (3) the use of multidimensional and dynamic relevance judgements. Hidden under the information need component is the essential central sub‐component, the simulated work task situation, the tool that triggers the (simulated) dynamic information needs. This paper also reports on the empirical findings of the metaevaluation of the application of this sub‐component, the purpose of which is to discover whether the application of simulated work task situations to future evaluation of IIR systems can be recommended. Investigations are carried out to determine whether any search behavioural differences exist between test persons‘ treatment of their own real information needs versus simulated information needs. The hypothesis is that if no difference exists one can correctly substitute real information needs with simulated information needs through the application of simulated work task situations. The empirical results of the meta‐evaluation provide positive evidence for the application of simulated work task situations to the evaluation of IIR systems. The results also indicate that tailoring work task situations to the group of test persons is important in motivating them. Furthermore, the results of the evaluation show that different versions of semantic openness of the simulated situations make no difference to the test persons’ search treatment.

Details

Journal of Documentation, vol. 56 no. 1
Type: Research Article
ISSN: 0022-0418

Keywords

Article
Publication date: 9 May 2016

Pia Borlund

The purpose of this paper is to report a study of how the test instrument of a simulated work task situation is used in empirical evaluations of interactive information retrieval…

1727

Abstract

Purpose

The purpose of this paper is to report a study of how the test instrument of a simulated work task situation is used in empirical evaluations of interactive information retrieval (IIR) and reported in the research literature. In particular, the author is interested to learn whether the requirements of how to employ simulated work task situations are followed, and whether these requirements call for further highlighting and refinement.

Design/methodology/approach

In order to study how simulated work task situations are used, the research literature in question is identified. This is done partly via citation analysis by use of Web of Science®, and partly by systematic search of online repositories. On this basis, 67 individual publications were identified and they constitute the sample of analysis.

Findings

The analysis reveals a need for clarifications of how to use simulated work task situations in IIR evaluations. In particular, with respect to the design and creation of realistic simulated work task situations. There is a lack of tailoring of the simulated work task situations to the test participants. Likewise, the requirement to include the test participants’ personal information needs is neglected. Further, there is a need to add and emphasise a requirement to depict the used simulated work task situations when reporting the IIR studies.

Research limitations/implications

Insight about the use of simulated work task situations has implications for test design of IIR studies and hence the knowledge base generated on the basis of such studies.

Originality/value

Simulated work task situations are widely used in IIR studies, and the present study is the first comprehensive study of the intended and unintended use of this test instrument since its introduction in the late 1990’s. The paper addresses the need to carefully design and tailor simulated work task situations to suit the test participants in order to obtain the intended authentic and realistic IIR under study.

Details

Journal of Documentation, vol. 72 no. 3
Type: Research Article
ISSN: 0022-0418

Keywords

Open Access
Article
Publication date: 31 May 2021

Jennifer L. Thoegersen and Pia Borlund

The purpose of this paper is to report a study of how research literature addresses researchers' attitudes toward data repository use. In particular, the authors are interested in…

4187

Abstract

Purpose

The purpose of this paper is to report a study of how research literature addresses researchers' attitudes toward data repository use. In particular, the authors are interested in how the term data sharing is defined, how data repository use is reported and whether there is need for greater clarity and specificity of terminology.

Design/methodology/approach

To study how the literature addresses researcher data repository use, relevant studies were identified by searching Library Information Science and Technology Abstracts, Library and Information Science Source, Thomas Reuters' Web of Science Core Collection and Scopus. A total of 62 studies were identified for inclusion in this meta-evaluation.

Findings

The study shows a need for greater clarity and consistency in the use of the term data sharing in future studies to better understand the phenomenon and allow for cross-study comparisons. Furthermore, most studies did not address data repository use specifically. In most analyzed studies, it was not possible to segregate results relating to sharing via public data repositories from other types of sharing. When sharing in public repositories was mentioned, the prevalence of repository use varied significantly.

Originality/value

Researchers' data sharing is of great interest to library and information science research and practice to inform academic libraries that are implementing data services to support these researchers. This study explores how the literature approaches this issue, especially the use of data repositories, the use of which is strongly encouraged. This paper identifies the potential for additional study focused on this area.

Details

Journal of Documentation, vol. 78 no. 7
Type: Research Article
ISSN: 0022-0418

Keywords

Article
Publication date: 1 April 1991

Vanja Orlans

Problems arise in attempting to evaluate Employee AssistanceProgrammes (EAP) in the widest sense. Terms such as“evaluation”, and “benefits” are regarded aspotentially complex, as…

Abstract

Problems arise in attempting to evaluate Employee Assistance Programmes (EAP) in the widest sense. Terms such as “evaluation”, and “benefits” are regarded as potentially complex, as is the adequate definition of what constitutes “employee assistance”. Studies concerned both with alcohol programmes and with stress management are reviewed; specific problems are highlighted. Methodology and the appropriateness of the traditional scientific method are much discussed. “Meta‐evaluation” is proposed to run concurrently with the unravelling of methodological questions in order to address the interfacing of programmes with other sections of the organisation, and the extent to which environmental and organisational factors rather than individuals are targeted for change.

Details

Employee Councelling Today, vol. 3 no. 4
Type: Research Article
ISSN: 0955-8217

Keywords

Article
Publication date: 17 August 2015

Roberto Linzalone and Giovanni Schiuma

This paper aims to review Program and Project evaluation Models. The assessment of the Evaluation Model (metaevaluation) is a critical step in Evaluation, as it is at the basis of…

6597

Abstract

Purpose

This paper aims to review Program and Project evaluation Models. The assessment of the Evaluation Model (metaevaluation) is a critical step in Evaluation, as it is at the basis of a successful Program/Project evaluation. A wide and effective review of EMs is a basic, as well as fundamental, support in meta-evaluation that affects positively the overall evaluation efficacy and efficiency. Despite a large number of reviews of EMs and a numerous population of EMs, developed in heterogeneous projects and programs settings, the literature lacks comprehensive collections and reviews of EMs that this paper addresses to provide a basis for the assessment of EMs.

Design/methodology/approach

Through a systematic literature review carried out via the Internet, and querying search engines, several models addressing program or project evaluation have been identified and analyzed. Following a process of normalization of the results gathered, they have been analyzed and compared according to key descriptive issues. They have been, at the end, summarized and rationalized in a comprehensive frame.

Findings

In recent years, evaluation studies have focused on the explanation of the mechanisms that underlie the transformation of projects’ and programs’ outputs into socio-economic effects, arguing that making them explicit allows to understand why a project or program is successful, as well as evaluating its extent. To assess and explain program’s and project’s effects, a basic, although fundamental, role in evaluation is played by the EM. A wide and heterogeneous set of 57 EMs has been identified, defined and framed in typologies, according to a systematic review research.

Originality/value

The approach to the review of EMs and the definition of a boundary of interest for management and economic researchers and practitioners represent an original issue of this paper.

Details

Measuring Business Excellence, vol. 19 no. 3
Type: Research Article
ISSN: 1368-3047

Keywords

Article
Publication date: 1 September 2002

Denis Leonard, Renee Reid and Rodney McAdam

It is often claimed that existing quality models can represent the development of total quality management (TQM) within organisations. However, the more recent emergence of…

2700

Abstract

It is often claimed that existing quality models can represent the development of total quality management (TQM) within organisations. However, the more recent emergence of critical perspective literature in this area has shown that these models lack both a strategic formulation influence and a dynamic influence for TQM in organisations. Seeks to combine these influences and to evaluate the role of the strategic dynamics of TQM within organisations. Thus, primarily aims to evaluate the strategic dynamics of TQM within case study organisations using an appropriate evaluative framework. A secondary aim is to perform a meta‐evaluation of this framework. The evaluative framework used for the study is Leonard’s grounded theory framework for TQM strategic dynamics. The model was applied to 57 case studies where a cross case analysis was used to guide the analysis. The findings show that the dynamics of TQM are much more complex and recursive than those shown by current models. Furthermore, the main influence of TQM in the cases was found to be at a tactical level and operational level. Those organisations, which applied TQM at a strategic level, were found to have robust TQM programmes with greater longevity, by using frequent regenerative approaches.

Details

International Journal of Quality & Reliability Management, vol. 19 no. 6
Type: Research Article
ISSN: 0265-671X

Keywords

Article
Publication date: 7 August 2017

Brendan Murtagh

This purpose of this paper is to concern with the extent to which social economies can be constructed as alternatives to private and state markets and their purported neoliberal…

Abstract

Purpose

This purpose of this paper is to concern with the extent to which social economies can be constructed as alternatives to private and state markets and their purported neoliberal tendencies.

Design/methodology/approach

The paper presents a meta-evaluation of an integrated set of projects supported by philanthropic investment to build finance, skills, entrepreneurship, social enterprises and non-monetised trading in the age sector in Northern Ireland.

Findings

The programme had important successes in stimulating social entrepreneurship, improving employability and showing how social enterprises can be incubated and scaled to offer new services for older people. It also improved skills in contract readiness, but this did not translate into new borrowing or trading models, even among larger NGOs.

Research limitations/implications

In that all economies are, to some extent, constructed and socially mediated, there is value in thinking through the components, relationships and projects that might make the ecosystem work more effectively. This should not just offer a counterweight to the market but could explore how an alternative arena for producing and consuming goods and services can be formed, especially among potentially vulnerable age communities.

Originality/value

The albeit, small-scale investment in a range of interrelated projects shows not only the value in experimentation but also the limits in planned attempts to construct social markets. The analysis shows that social economies need to respond to the priorities of older people, grown from community initiatives and better connected to the capabilities and resources of the sector.

Details

Social Enterprise Journal, vol. 13 no. 3
Type: Research Article
ISSN: 1750-8614

Keywords

Article
Publication date: 1 July 2006

Lawrence St Leger

To highlight the challenges and identify options to improve school health evaluations.

663

Abstract

Purpose

To highlight the challenges and identify options to improve school health evaluations.

Design/methodology/approach

This editorial draws on recent international and national meta‐evaluations and the experiences of the author.

Findings

A simple set of questions is needed for discussion between those commissioning evaluations and those conducting them to make school health evaluations more effective and relevant to stakeholders.

Originality/value

The paper identifies important steps which need to be considered in undertaking evaluations of school health interventions.

Details

Health Education, vol. 106 no. 4
Type: Research Article
ISSN: 0965-4283

Keywords

Article
Publication date: 2 March 2010

Yadollah Mehralizadeh and Massoud Safaeemoghaddam

The main purpose of this paper is study to what extent the idea of a total quality management (TQM) system (Deming, ISO, Baldrige, and EFQM) which is borrowed from business is…

4129

Abstract

Purpose

The main purpose of this paper is study to what extent the idea of a total quality management (TQM) system (Deming, ISO, Baldrige, and EFQM) which is borrowed from business is applicable in a higher education institution.

Design/methodology/approach

A meta‐evaluation methodology is used which emphasises Røvik's seven theoretical assumptions on how management ideas are spread in a given sector.

Findings

The findings of this paper reveal that that in many cases the current evidence of application of TQM is not compatible with the assumed criteria of the Røvik model. The quality systems are not often socially acceptable, they do not follow a clear philosophy and theory, do not show the productivity of institutions, are less progressive, have low harmonies, unrealistically publicized but in terms of individualized aspects there are some supportive successful case applied in non‐academic higher education.

Originality/value

The value and new message of this paper is its investigation of the fitness of TQM from a new perspective based on meta‐analysis.

Details

The TQM Journal, vol. 22 no. 2
Type: Research Article
ISSN: 1754-2731

Keywords

1 – 10 of 118