Search results

The role of dialogue has recently been identified as being important in generating impact in organisations, but the purposeful use of narrative or story-based approaches to effect organisational change and service improvement is still relatively innovative. The purpose of this paper is to document and examine two projects in health and social care settings which aim to generate organisational development and service improvement.

The paper evaluates and compares two case studies of story-based organisational development and service improvement projects in the UK. This involved developing an appropriate evaluation framework and assessing the impacts in each case using semi-structured interviews and thematic content analysis.

This paper reports the diversity of impacts and outcomes that were generated by the projects. Specifically, it is argued that there is a strong indication that story-based projects best achieve their objectives when clearly linked to key organisational strategic drivers or pathways, as evidenced by robust evaluation.

This paper recommends that researchers and practitioners, working with story-based methods, design credible and robust evaluative practices, in order to evidence how their work supports organisations to meet current sector challenges. The paper recommends a flexible evaluation framework for evaluating story-based projects in the workplace.

This paper offers new evidence and insight into the impacts and outcomes of using story-based approaches, and a new evaluation framework for these sorts of projects.

During the evaluation of European Capital of Culture (ECoC) Aarhus 2017, the evaluation organisation rethinkIMPACTS 2017 formulated a set of “dilemmas” capturing the main challenges arising during the design of the ECoC evaluation. This functioned as a framework for the evaluation process. This paper aims to present and discuss the relevance of the “Evaluation Dilemmas Model” as subsequently applied to the Galway 2020 ECoC programme evaluation.

The paper takes an empirical approach including auto-ethnography and interview data to document and map the dilemmas involved in undertaking an evaluation in two different European cities. Evolved via a process of practice-based research, the article addresses the development of and the arguments for the dilemmas model and considers its potential for wider applicability in the evaluation of large-scale cultural projects.

The authors conclude that the “Evaluation Dilemmas Model” is a valuable heuristic for considering the endogenous and exogenous issues in cultural evaluation.

The model developed is useful for a wide range of cultural evaluation processes including – but not limited to – European Capitals of Culture.

What has not been addressed in the academic literature is the process of evaluating ECoCs; especially how evaluators often take part in an overall process that is not just about the evaluation but also planning and delivering a project that includes stakeholder management and the development of evaluation criteria, design and methods.

The purpose of this study is to assess the contributions of graduate research to social innovation and change for learning and improved transdisciplinary practice. Universities, as centers of teaching and research, face high demand from society to address urgent social and environmental challenges. Faculty and students are keen to use their research to contribute to social innovation and sustainable development. As part of the effort to increase societal impact, research approaches are evolving to be more problem-oriented, engaged and transdisciplinary. Therefore, new approaches to research evaluation are also needed to learn whether and how research contributes to social innovation, and those lessons need to be applied by universities to train and support students to do impactful research and foster an impact culture.

This paper uses a theory-based evaluation method to assess the contributions of three completed doctoral research projects. Each study documents the project’s theory of change (ToC) and uses qualitative data (document review, surveys and interviews) to test the ToC. This paper uses a transdisciplinary research (TDR) quality assessment framework (QAF) to analyze each projects’ design and implementation. This paper then draws lessons from the individual case studies and a comparative analysis of the three cases on, namely, effective research design and implementation for social transformation; and training and support for impactful research.

Each project aimed to influence government policy, organizational practice, other research and/or the students’ own professional development. All contributed to many of their intended outcomes, but with varying levels of accomplishment. Projects that were more transdisciplinary had more pronounced outcomes. Process contributions (e.g. capacity-building, relationship-building and empowerment) were as or more important than knowledge contributions. The key recommendations are for: researchers to design intentional research, with an explicit ToC; higher education institutions (HEI) to provide training and support for TDR theory and practice; and HEIs to give more attention to research evaluation.

This is the first application of both the outcome evaluation method and the TDR QAF to graduate student research projects, and one of very few such analyses of research projects. It offers a broader framework for conceptualizing and evaluating research contributions to social change processes. It is intended to stimulate new thinking about research aims, approaches and achievements.

The aim of this paper is to generate a streamlined, transparent and effective instrument to fairly measure the contribution made by each student to a group project within a higher education context. The primary aim is to moderate the grades of underperforming students at the end of the project. There is a secondary benefit in alerting underperforming students to raise their contribution mid-task or face a potentially reduced grade at the final stage.

The development of this multi-dimensional instrument is guided by findings from previous research. The quest is to minimise the instructor's administrative work load in applying a moderation-only instrument that is open-source and available at no cost. Based on the literature, the survey instrument seeks to apply a peer-based, equitable and transparent evaluation of each member's contribution to a group task. The survey is applied at mid-task and again at end-task in order to afford underperformers the opportunity to address contribution deficits during the final phase of the project.

The instrument, called TANDEM©, offers a transparent, streamlined, equitable, confidential and practical measure of each student's contribution to a graded group task. Students whose end-task contribution falls below the group average rating receive a proportional reduction in their personal grade. Additionally, the end-task moderation instrument captures a single-item holistic measure of relative contribution that may, in the future, serve as a surrogate for the multi-dimensional measures currently in place.

TANDEM© was developed with group sizes of four or five members in mind. There is no evidence to support its application to three-person groups. Moreover, the application was applied only amongst under-graduate students. It is yet to be applied across post-graduate groups and within online learning environments. Future research into diverse cultural settings would serve to advance understanding of how moderation is perceived across borders.

Several existing group grade moderation methods propose complex algorithms that are “black box” solutions from a student's perspective. In establishing a fair, streamlined, confidential and transparent process for peer-rated moderation, TANDEM© deploys a concise instrument with a relatively small administrative load. TANDEM © may be applied to all groups or can selectively be applied to groups that report moderate, strong or extreme levels of conflict.

Students will appreciate the opportunity to rate peer contributions to group projects. This will dissipate the negative social sentiment that may arise when fellow students benefit from the work of others. Those students seeking conflict resolution within the group will value the transparent and equitable moderation of grades as well as the positive social implications that follow.

This research forms part of an ongoing quest to present a moderation instrument that fairly identifies student contribution to a group project. Whilst the solution proposed is one of many existing alternatives, its focus is on a practical moderation-only instrument that can immediately be applied to a course or major. The benefits lie in the ease of application and minimal administrative workload. This constitutes an original contribution to the individual (course or major) coordinator who seeks to apply a moderation-only instrument without having to commit to an extensive, broad-based group optimisation programme.

Uncertainty management (UM) in projects has been a point of attention for researchers for many years. Research on UM has mainly been aimed at uncertainty analyses in the front-end and managing uncertainty in the construction phase. In contrast, UM components in the design phase have received less attention. This research aims to improve knowledge about the key components of UM in the design phase of large road projects.

This study adopted a literature review and case study. The literature review was used to identify relevant criteria for UM. These criteria helped to design the interview guide. Multiple case study research was conducted, and data were collected through document study and interviews with project stakeholders in two road projects. Each case's owners, contractors and consultants were interviewed individually.

The data analysis obtained helpful information on the involved parties, process and exploit tools and techniques during the design phase. Johansen's (2015) framework [(a) human and organisation, (b) process and (c) tools and techniques)] was completed and developed by identifying relevant criteria (such as risk averse or risk-taker, culture and documentation level) for each component. These criteria help to measure UM performance. The authors found that owners and contractors are major formal UM actors, not consultants. Empirical data showed the effectiveness of Web-based tools in UM.

The studied cases were Norwegian, and this study focussed on uncertainties in the project's design phase. Relevant criteria did not cover all the criteria for evaluating the performance of UM. Qualitative evaluation of criteria allows further quantitative analysis in the future.

This paper gave project owners and managers a better understanding of relevant criteria for measuring UM in the owners and managers' projects. The paper provides policy-makers with a deeper understanding of creating rigorous project criteria for UM during the design phase. This paper also provides a guideline for UM in road projects.

This research gives a holistic evaluation of UM by noticing relevant criteria and criteria's interconnection in the design phase.

The purpose of this paper is to discuss contemporary knowledge relevant to the application of performance measurement (PMe) in the concept of OPM and to compare findings from a literature review with solutions recommended for utilization by managers from general contractors operating in Poland. There are few studies related to the mentioned topic, much fewer describing the geographical area of Eastern Europe.

Triangulation of research methods was selected. First literature review, next desk research and finally descriptive statistical analysis and interview were conducted. The research methods were applied in three steps whose beginnings overlapped and the mid-term findings from one study complemented others.

PMe should be focused on management and governance issues. Its evaluation is related to various organizational levels (permanent organization, portfolio, program, project, construction site and supply chain), most of them are under valuated by practitioners. The conducted study pointed out that there are numerous supporting tools and measures applicable in organizational project management (OPM). The managers recommend combining various tools in one comprehensive OPM system, to limit multiple manual incorporations of the same data to the various databases. The managers call to increase the practical usefulness of researchers’ proposals, to educate the construction managers in the application of complex performance systems and to promote portfolio thinking.

The comparison of performance measurement solutions proposed by academia with experience collected from Polish construction managers could support the better application of theoretical ideas in practice.

Exposure to isocyanates was the leading cause of occupational asthma in the UK. Motor vehicle repair (MVR) bodyshop paint sprayers were at greatest risk, despite widespread use of air-fed breathing apparatus and ventilated booths. Most paint sprayers work in small and medium enterprises (SMEs). The purpose of the Health and Safety Executive (HSE) project, described in this paper, is to improve exposure control measures in at least 20 per cent of MVR bodyshops, and reduce the risk of occupational asthma. The paper aims to discuss this issue.

A three-stranded plan consisted of: Safety and Health Awareness Days (SHADs); workplace inspections; and third-party stakeholder communications. The impact of various parts of the project were evaluated.

Approximately 18 per cent of bodyshops in the UK attended one of 32 SHADs, following which over 90 per cent of delegates expressed an “intention to act” to improve exposure control measures. A local assessment showed that at least 50 per cent of bodyshops improved exposure control measures. An evaluation of 109 inspections found that enforcement action was taken at 40 per cent of visits. Third-party engagement produced a joint HSE-industry designed poster, new agreed guidance on spray booths and dissemination of SHAD material. Knowledge of booth clearance time has become widespread, and 85 per cent of booths now have pressure gauges. Biological monitoring data show that, post-SHAD, exposures were lower.

A sustained national project using clear, relevant, tested messages delivered via different routes, had a sector-wide impact in bodyshops. It is probable that the project has improved isocyanate exposure control in at least 20 per cent of bodyshops. The generic lessons could be applied to other widespread SME businesses.

The purpose of this paper is to study public project governance frameworks in various ministries and agencies in Norway, following the introduction of such a framework on the topmost level (i.e. the cabinet) which applies to the very largest projects.

The study is methodologically designed as a qualitative assessment of project governance frameworks that apply to state-funded investment projects in selected sectors, based on data gathered through document reviews and interviews.

The study finds that all of the agencies have introduced their own project governance frameworks, which are basically consistent with the recommendations from the project management literature and with the cabinet’s overall requirements in Norway. By contrast, only one ministry has taken a formalized role as a project owner. Governance tasks thus seem to be extensively delegated to the subordinate agencies. This even includes strategic tasks such as project selection and portfolio management, and implies there is a risk that public project governance has a narrow and internal focus.

The paper is a first step toward a better understanding of public project governance as a hierarchical system and the relationship between project owners on three levels, the cabinet, the sectoral ministry, and the government agency.