Search results

1 – 10 of over 114000
Article
Publication date: 1 March 1993

Godwin J. Udo

Discusses how most organizations use formal methods which arepurely objective and rational to evaluate system projects. Such methodsare incapable of capturing the social aspects…

Abstract

Discusses how most organizations use formal methods which are purely objective and rational to evaluate system projects. Such methods are incapable of capturing the social aspects of system projects and as such are not appropriate. Inappropriate evaluation mechanisms and criteria have caused the detrimental effects of organizational bias to flourish, thereby defeating the purposes of project evaluation. Organizations, either knowingly or unknowingly, are judging instead of evaluating projects with the intention to punish or reward the project teams and so encourage biasing effects. Contends that an effective project evaluation should adopt a socio‐technical approach to reflect the socio‐technical nature of information systems. Describes and illustrates managerial guidelines on socio‐technical approach to project evaluation capable of accounting and controlling for the obvious effects of organizational bias.

Details

Industrial Management & Data Systems, vol. 93 no. 3
Type: Research Article
ISSN: 0263-5577

Keywords

Article
Publication date: 19 June 2023

Jose Oliveros-Romero and Ajibade A. Aibinu

This study aims to develop an ex-post impact evaluation method for public-private partnership projects (PPP) that addresses one of its main difficulties: the multiplicity of…

Abstract

Purpose

This study aims to develop an ex-post impact evaluation method for public-private partnership projects (PPP) that addresses one of its main difficulties: the multiplicity of perspectives and stakeholders that exist in these projects.

Design/methodology/approach

This study first developed a conceptual evaluation framework called ‘Project Success Evaluation Pyramid Model’ (PSEPM) that was designed using a Design Science approach. Second, an impact evaluation method was designed based on the PSEPM. This evaluation method was tested and refined using three PPP projects. This article presents the refined conceptual model PSEPM, the evaluation method and one of the three tests: the PPP toll road.

Findings

The impact evaluation method describes how to evaluate the impact of an existing mega project from the perspective of multiple stakeholders and isolate the impact of the procurement method. Its application in practice is demonstrated with a PPP toll road project in Chile, in which 11 stakeholders were identified. Issues such as city segregation, deficient business model, the relevance of infrastructure availability, and deficient service-fee strategy were identified in the project. The evaluation method provides a judgement about the use of the PPP procurement method and about the overall impact of the project, reconciling the stakeholder perspectives.

Originality/value

The use of this approach could give greater clarity and legitimacy to the discussion over the use of PPPs by evaluating existing projects beyond the use of traditional time and cost measurements. Its originality is the systematic recognition and identification of stakeholder motives, purposes, and judgements over a project.

Details

Built Environment Project and Asset Management, vol. 13 no. 4
Type: Research Article
ISSN: 2044-124X

Keywords

Article
Publication date: 1 February 2001

Maureen Jackson

Discusses the reasons why the HyLiFe project, which focussed on hybrid libraries, needed to be evaluated, and the ways in which the information gathered was used to solve problems…

2782

Abstract

Discusses the reasons why the HyLiFe project, which focussed on hybrid libraries, needed to be evaluated, and the ways in which the information gathered was used to solve problems and aid decision making. It reviews who should be involved in the evaluation process, what should be evaluated, the methods to be used, the findings of the process. Most of the difficulties throughout the evaluation concerned people, not technology.

Details

Library Management, vol. 22 no. 1/2
Type: Research Article
ISSN: 0143-5124

Keywords

Article
Publication date: 4 March 2014

Ekaterina A. Makarova and Anna Sokolova

The aim of this paper is to identify ways for improvement of the foresight evaluation framework on the basis of analysis and systematisation of accumulated experience in the field

2967

Abstract

Purpose

The aim of this paper is to identify ways for improvement of the foresight evaluation framework on the basis of analysis and systematisation of accumulated experience in the field of project management.

Design/methodology/approach

The paper is based on a detailed literature review devoted to an evaluation of foresight and traditional projects. The approaches to project evaluation in the field of project management were investigated, and the main steps of traditional project evaluation process were determined. The most commonly applied steps of foresight evaluation were identified by the analysis of recent foresight evaluation projects. The comparison of evaluation frameworks for foresight projects and traditional projects allows to provide recommendations for foresight evaluation framework improvement.

Findings

The paper identifies several lessons for foresight evaluation from project management. The elements which can enrich foresight evaluation framework are the following: the development of an evaluation model; the extensive use of quantitative methods; the elaboration of evaluation scales; the inclusion of economic indicators into evaluation; and the provision of more openness and transparency for evaluation results.

Originality/value

Given the importance of foresight evaluation procedures and the lack of a commonly applied methodological approach, the value of this paper consists in identifying a foresight evaluation framework and enriching it with elements of project management.

Details

Foresight, vol. 16 no. 1
Type: Research Article
ISSN: 1463-6689

Keywords

Article
Publication date: 23 August 2013

Pam Moule, David Evans and Katherine Pollard

– This article aims to analytically review the Plan-Do-Study-Act (PDSA) model used in the Pacesetters national programme evaluation.

5612

Abstract

Purpose

This article aims to analytically review the Plan-Do-Study-Act (PDSA) model used in the Pacesetters national programme evaluation.

Design/methodology/approach

The evaluation team's two-fold role is outlined: supporting project teams to develop PDSA plans and collect evaluation data. Four case studies are used to show the PDSA model's application and effect in a participatory action learning approach. Despite limitations, it is clear that all four case studies illustrate the PDSA model's potential benefits in a participatory evaluation approach, which involves public and patients.

Findings

The model's effectiveness is premised on several enabling factors such as: teams appreciating the model; a climate that values all learning and open to re-planning; engaging any external evaluators whose role is clearly communicated to all project stakeholders in a timely fashion.

Practical implications

There are clear intentions to promote evidence-based commissioning in the UK that values patient and public involvement. The PDSA model has the potential to test and implement changes in real work-place settings and to involve the public in evaluation.

Originality/value

Case study analysis identifies new reflections on the PDSA model's use to support innovative NHS practice development with public involvement in a participatory approach.

Details

International Journal of Health Care Quality Assurance, vol. 26 no. 7
Type: Research Article
ISSN: 0952-6862

Keywords

Article
Publication date: 17 August 2015

Roberto Linzalone and Giovanni Schiuma

This paper aims to review Program and Project evaluation Models. The assessment of the Evaluation Model (metaevaluation) is a critical step in Evaluation, as it is at the basis of…

6597

Abstract

Purpose

This paper aims to review Program and Project evaluation Models. The assessment of the Evaluation Model (metaevaluation) is a critical step in Evaluation, as it is at the basis of a successful Program/Project evaluation. A wide and effective review of EMs is a basic, as well as fundamental, support in meta-evaluation that affects positively the overall evaluation efficacy and efficiency. Despite a large number of reviews of EMs and a numerous population of EMs, developed in heterogeneous projects and programs settings, the literature lacks comprehensive collections and reviews of EMs that this paper addresses to provide a basis for the assessment of EMs.

Design/methodology/approach

Through a systematic literature review carried out via the Internet, and querying search engines, several models addressing program or project evaluation have been identified and analyzed. Following a process of normalization of the results gathered, they have been analyzed and compared according to key descriptive issues. They have been, at the end, summarized and rationalized in a comprehensive frame.

Findings

In recent years, evaluation studies have focused on the explanation of the mechanisms that underlie the transformation of projects’ and programs’ outputs into socio-economic effects, arguing that making them explicit allows to understand why a project or program is successful, as well as evaluating its extent. To assess and explain program’s and project’s effects, a basic, although fundamental, role in evaluation is played by the EM. A wide and heterogeneous set of 57 EMs has been identified, defined and framed in typologies, according to a systematic review research.

Originality/value

The approach to the review of EMs and the definition of a boundary of interest for management and economic researchers and practitioners represent an original issue of this paper.

Details

Measuring Business Excellence, vol. 19 no. 3
Type: Research Article
ISSN: 1368-3047

Keywords

Article
Publication date: 1 February 1999

Joan A. Ballantine and Stephanie Stray

Reports on the findings of two surveys which examined the way organisations evaluate information systems/technology and other capital of investments. The issues addressed include…

3499

Abstract

Reports on the findings of two surveys which examined the way organisations evaluate information systems/technology and other capital of investments. The issues addressed include the following: the extent of evaluation; the extent to which evaluation depends on organisational factors, such as project cost and level of organisational turnover; the existence of formal procedures of evaluation; the financial and other criteria used to evaluate investments, and their importance; and the problems organisations face when evaluating both types of investment. In addressing the above issues the study serves two objectives: first, the findings provide valuable insights regarding the way both types of investments are evaluated, which is currently lacking in both the information systems and the accounting and finance literature, and second, the findings enable confirmation or refutation of some of the popular myths which exist in the information systems literature that such investments are different, are therefore evaluated in a “different” way and present “different” problems when compared to other types of organisational investment.

Details

Logistics Information Management, vol. 12 no. 1/2
Type: Research Article
ISSN: 0957-6053

Keywords

Article
Publication date: 1 December 2003

Margaret Barry

This paper describes the development of an evaluation framework to document the process, impact and outcomes of a community‐based mental health promotion project. This initiative…

Abstract

This paper describes the development of an evaluation framework to document the process, impact and outcomes of a community‐based mental health promotion project. This initiative, the Rural Mental Health Project, is concerned with the promotion of positive mental health in rural communities in the Republic and Northern Ireland. As a community‐based initiative, this project involves multi‐component interventions that are implemented with diverse target groups across a range of community settings. Assessing the process of programme implementation is critical in order to capture and document the realities of programme planning and implementation. The evaluation approach adopted in this project is based on a logic model research paradigm (Scheirer et al, 1995). This model gives equal emphasis to process and outcome evaluation and seeks to relate the realities of programme implementation to intended programme outcomes. Project activity is tracked prospectively in order to examine the detail of actual programme delivery and its influence on expected project outcomes. This paper outlines the model as applied in this project and explores the methodological and practical challenges in evaluating complex community interventions.

Details

Journal of Public Mental Health, vol. 2 no. 4
Type: Research Article
ISSN: 1746-5729

Article
Publication date: 27 August 2021

Jinchan Liu, Yubo Guo, Igor Martek, Chuan Chen and Jiawei Tian

This study develops a phase-oriented evaluation mechanism based on the public–private partnership (PPP) project process and provides a preliminary framework for the promotion of…

Abstract

Purpose

This study develops a phase-oriented evaluation mechanism based on the public–private partnership (PPP) project process and provides a preliminary framework for the promotion of the phase-oriented evaluation of PPPs in China.

Design/methodology/approach

Through a literature review and survey interviews the success criteria for the implementation process of PPPs are documented. Process success criteria findings are used to populate the content of the phase-oriented evaluation. The result is then tested, revised and improved through follow-up expert interviews.

Findings

This paper identifies PPP project process success criteria. Using these criteria, a phase-oriented evaluation framework is developed. Moreover, in consultation with industry experts in the PPP field, eight evaluation aspects were determined: confirmation of project compliance and performance, confirmation of value for money, confirmation of financial affordability, trend analysis of annual performance appraisal, risk review and early warning, rebankability analysis, project externality analysis, benchmarking analysis of similar projects. These eight application aspects are analyzed in the light of the outcomes of the resulting phase-oriented evaluation framework.

Research limitations/implications

The results of the research can only provide researchers and practitioners with generic insights regarding inputs into a phase-oriented evaluation of PPP projects. For any specific PPP project, the focus and priority of the evaluative content will vary.

Practical implications

A phase-oriented evaluation of PPP projects is put forward. This will allow project stakeholders to better track the progress of projects throughout what can be a lengthy implementation stage.

Originality/value

This study can provide governments and stakeholders with a new, theoretical understanding as to factors required of an effective phased evaluation of China's PPP projects. In that regard it will be significant value in PPP project policy and decision-making.

Details

Engineering, Construction and Architectural Management, vol. 29 no. 9
Type: Research Article
ISSN: 0969-9988

Keywords

Article
Publication date: 21 April 2020

Zhao Xu, Xiang Wang, Ya Xiao and Jingfeng Yuan

There is often a lack of accurate performance evaluation in Public–Private Partnership (PPP) projects. It is a challenging issue to effectively use Building Information Modeling…

1022

Abstract

Purpose

There is often a lack of accurate performance evaluation in Public–Private Partnership (PPP) projects. It is a challenging issue to effectively use Building Information Modeling (BIM) for PPP project performance evaluation. The objective of this study is to develop a PPP project performance evaluation model based on Industry Foundation Classes (IFC) and an enhanced matter-element method to more precisely evaluate PPP project performance.

Design/methodology/approach

The performance evaluation of PPP projects in the construction and operation period was explored. The PPP project performance evaluation indicator system was first established based on a literature review and PPP project practice. Then, the evaluation indicator information was expressed through IFC mapping and extension. After that, an IFC-based PPP project performance evaluation model was developed, and a case study was provided to validate the use of the proposed performance evaluation model.

Findings

The results of the case study show that the proposed approach can accurately and efficiently evaluate PPP projects, and it could favorably contribute to performance evaluation in PPP projects.

Research limitations/implications

This study only concerns the performance evaluation of one type of PPP project. Further research is required to study different types of PPP projects; the model needs to be more efficient and intelligent.

Originality/value

The performance evaluation of PPP projects utilizing IFC extension and the enhanced matter-element method provides guidance for the government and private parties to accurately and efficiently evaluate PPP project performance.

Details

Engineering, Construction and Architectural Management, vol. 27 no. 8
Type: Research Article
ISSN: 0969-9988

Keywords

1 – 10 of over 114000