Search results

During the evaluation of European Capital of Culture (ECoC) Aarhus 2017, the evaluation organisation rethinkIMPACTS 2017 formulated a set of “dilemmas” capturing the main challenges arising during the design of the ECoC evaluation. This functioned as a framework for the evaluation process. This paper aims to present and discuss the relevance of the “Evaluation Dilemmas Model” as subsequently applied to the Galway 2020 ECoC programme evaluation.

The paper takes an empirical approach including auto-ethnography and interview data to document and map the dilemmas involved in undertaking an evaluation in two different European cities. Evolved via a process of practice-based research, the article addresses the development of and the arguments for the dilemmas model and considers its potential for wider applicability in the evaluation of large-scale cultural projects.

The authors conclude that the “Evaluation Dilemmas Model” is a valuable heuristic for considering the endogenous and exogenous issues in cultural evaluation.

The model developed is useful for a wide range of cultural evaluation processes including – but not limited to – European Capitals of Culture.

What has not been addressed in the academic literature is the process of evaluating ECoCs; especially how evaluators often take part in an overall process that is not just about the evaluation but also planning and delivering a project that includes stakeholder management and the development of evaluation criteria, design and methods.

This study aims to draw on cue utilization and irradiation theories to: determine the extent to which country-of-origin image and its sub-dimensions exert an aggregate and relative influence on consumer brand evaluations; and identify the contextual and methodological factors that account for between-study variance in the focal relationship.

A random-effects model was used to examine 166 empirical articles encompassing 499,563 observations, and 282 effect sizes from 1984 to 2020 using Comprehensive Meta-Analysis software.

Results show that country-of-origin image has a positive, moderate effect on consumer brand evaluations. Moreover, findings reveal that each dimension of country-of-origin image – general country image, general product country image, specific product country image and partitioned country image – significantly influences consumer brand evaluation, but the effect of general product country image is the largest. What’s more, the aggregate impacts of country-of-origin image on consumer brand evaluation – brand commitment, brand-specific associations and general brand impressions – show that the effect on brand commitment is the largest. Finally, findings show that contextual factors (brand source, product sector, culture [individualism vs collectivism], brand origin continents and respondents’ continent) and methodological factors (cues, sampling unit, publication year and sample size) significantly account for between-study variance.

This study provides the first meta-analytic review of the relationship between country-of-origin image and consumer brand evaluation to help clarify mixed findings and balance out the literature, which has only seen quantitative reviews on product evaluation and purchase decisions.

Calls for the development and dissemination of evidence-based programs to support children and families have been increasing for decades, but progress has been slow. This paper aims to argue that a singular focus on evaluation has limited the ways in which science and research is incorporated into program development, and advocate instead for the use of a new concept, “scientific accompaniment,” to expand and guide program development and testing.

A heuristic is provided to guide research–practice teams in assessing the program’s developmental stage and level of evidence.

In an idealized pathway, scientific accompaniment begins early in program development, with ongoing input from both practitioners and researchers, resulting in programs that are both effective and scalable. The heuristic also provides guidance for how to “catch up” on evidence when program development and science utilization are out of sync.

While implementation models provide ideas on improving the use of evidence-based practices, social service programs suffer from a significant lack of research and evaluation. Evaluation resources are typically not used by social service program developers and collaboration with researchers happens late in program development, if at all. There are few resources or models that encourage and guide the use of science and evaluation across program development.

The purpose of this co-produced research project was to conduct interviews with people working in, volunteering with and accessing Canadian recovery colleges (RCs) to explore their perspectives on what an evaluation strategy for RCs could look like.

This study used a participatory action research approach and involved semistructured interviews with 29 people involved with RCs across Canada.

In this paper, the authors share insights from participants about the purposes of RC evaluation; key elements of evaluation; and the most applicable and effective approaches to evaluation. Participants indicated that RC evaluations should use a personalized, humanistic and accessible approach. The findings suggest that evaluations can serve multiple purposes and have the potential to support both organizational and personal-recovery goals if they are developed with meaningful input from people who access and work in RCs.

The findings can be used to guide evaluations in which aspects that are most important to those involved in RCs could inform choices, decisions, priorities, developments and adaptations in RC evaluation processes and, ultimately, in programming.

A recent scoping review revealed that although coproduction is a central feature of the RC model, coproduction principles are rarely acknowledged in descriptions of how RC evaluation strategies are developed. Exploring coproduction processes in all aspects of the RC model, including evaluation, can further the mission of RCs, which is to create spaces where people can come together and engage in mutual capacity-building and collaboration.

This study aims to examine the links between office types (cellular, shared-room, small and medium-sized open-plan) and employees' subjective well-being regarding cognitive and affective evaluations and the role perceived noise levels at work has on the aforementioned associations.

A survey with measures of office types, perceived noise levels at work and the investigated facets of subjective well-being (cognitive vs affective) was distributed to employees working as real estate agents in Sweden. In total, 271 useable surveys were returned and were analyzed using analyses of variance (ANOVAs) and a regression-based model mirroring a test of moderated mediation.

A significant difference was found between office types on the well-being dimension related to cognitive, but not affective, evaluations. Employees working in cellular and shared-room offices reported significantly higher ratings on this dimension than employees working in open-plan offices, and employees in medium-sized open-plan offices reported significantly lower cognitive evaluation scores than employees working in all other office types. This pattern of results was mediated by perceived noise levels at work, with employees in open-plan (vs cellular and shared-room) offices reporting less satisfactory noise perceptions and, in turn, lower well-being scores, especially regarding the cognitive (vs affective) dimension.

This is one of the first studies to compare the relative impact of office types on both cognitive and affective well-being dimensions while simultaneously testing and providing empirical support for the presumed process explaining the link between such aspects.

For the past four decades, there is no evidence of a consensus on the suitable community-based rehabilitation (CBR) evaluation methodologies. To this end, the purpose of this study is to provide a narrative review on CBR evaluations and the potential of photovoice method when used alone and when used in combination with quality of life assessment tools as CBR evaluation methodologies.

A narrative review was undertaken, but including some aspects of scoping review methodology.

Thirty-three full-text articles were included for review. Three key findings were an overview of the evolution of CBR evaluation; the use of photovoice method in CBR evaluation and the use of photovoice method in combination with quality of life assessment tools in CBR evaluation.

Photovoice methodology was found to be participatory in nature and as has the potential to elicit the experiences of persons with disabilities. However, photovoice falls short of measuring the quality of life of persons with disabilities, thus will need to be collaborated with another assessment tool. A combination of photovoice and World Health Organization Quality of Life (WHOQOL)-BREF and WHOQOL-Dis assessment has a potential to give an adequate representation of the voices of persons with disabilities and their quality of life.

There is need for changes in CBR evaluation methodologies in response to the evolution of disability models from medical model to human rights model. Thus CBR evaluation methodologies should embrace the diversity among persons with disabilities in interpreting life experiences and quality of life.

Since 2006, higher education institutions (HEIs) in Sweden, should according to the Higher Education Act, promote sustainable development (SD). In 2016, the Swedish Government asked the Swedish higher education authority to evaluate how this study is proceeding. The authority chose to focus on education. This paper aims to produce a report on this evaluation.

All 47 HEIs in Sweden were asked to write a self-evaluation report based on certain evaluation criteria. A panel was appointed consisting of academics and representatives for students and working life. The panel wrote an evaluation of each HEI, a report on general findings and recommendations, and gave an overall judgement of each HEI in two classes as follows: the HEI has well-developed processes for integration of SD in education or the HEI needs to develop their processes.

Overall, a mixed picture developed. Most HEIs could give examples of programmes or courses where SD was integrated. However, less than half of the HEIs had overarching goals for integration of SD in education or had a systematic follow-up of these goals. Even fewer worked specifically with pedagogy and didactics, teaching and learning methods and environments, sustainability competences or other characters of education for SD. Overall, only 12 out of 47 got a higher judgement.

This is a unique study in which all HEIs in a country are evaluated. This provides unique possibilities for identifying success factors and barriers. The importance of the leadership of the HEIs became clear.

The purpose of this paper is to generalize the traditional risk evaluation methods and to specify a multi-level risk evaluation framework, in order to prepare customized risk evaluation and to enable effectively integrating the elements of risk evaluation.

A real case study of an electric motor manufacturing company is presented to illustrate the advantages of this new framework compared to the traditional and fuzzy failure mode and effect analysis (FMEA) approaches.

The essence of the proposed total risk evaluation framework (TREF) is its flexible approach that enables the effective integration of firms’ individual requirements by developing tailor-made organizational risk evaluation.

Increasing product/service complexity has led to increasingly complex yet unique organizational operations; as a result, their risk evaluation is a very challenging task. Distinct structures, characteristics and processes within and between organizations require a flexible yet robust approach of evaluating risks efficiently. Most recent risk evaluation approaches are considered to be inadequate due to the lack of flexibility and an inappropriate structure for addressing the unique organizational demands and contextual factors. To address this challenge effectively, taking a crucial step toward customization of risk evaluation.

This article is the second part of the research on the institutional evaluation of the open universities. The title of the first one was ‘Evaluation Standards for Institutional Evaluation of Open Universities,’ which was presented at the 22nd AAOU Annual Conference, Tianjin, China. In the previous study we discussed the definition of university evaluation and some of the controversial points in the existing evaluation. The focal point was that the existing standards and indexes are not appropriate for Korea National Open University (KNOU) as an open university, and that it is necessary to establish a new evaluating system for the university. We believe it is true of the other open universities throughout Asia and the world. In short, the present research provides the practical and effective data on the evaluation standard. It also includes some new qualitative, quantitative and modified evaluation indexes reflecting the distinctive features of the open universities. The main part of this article elaborates on 5 evaluation domains, 23 evaluation sections, 81 evaluation items and 229 evaluation indexes. These evaluation domains, sections, items and indexes result from the practical surveys and AHP and Swing analyses. The result of this research will prove a good and essential element for ranking indicators in ODE universities. At the end of the paper we add some new standards and indexes for evaluating regional campuses of the open universities, which is another important agenda for upgrading the learner support throughout the country.

The purpose of this paper is to explore how actors subjected to public performance evaluations may “contest commensuration,” i.e. may seek to influence how such ratings and rankings will be construed among important stakeholders.

A qualitative study of press releases, and interviews with department heads, is used as a basis for the analysis.

The empirically derived taxonomy of public responses to a state-initiated performance evaluation of educational programs shows that actors may mobilize an array of commensuration management tactics so as to maintain or improve one’s relative positional status. Such tactics may have at least three different foci, namely, on the comparison object (i.e. on the new grouping of actors), the comparison dimension (i.e. the standardized format for comparison) and the comparison rate (i.e. the rate received), respectively. The authors also find that not only are threats to positional status likely to spur commensuration management tactics, but also the opportunity to exploit a good rate.

The paper augments recent research that has problematized the so-called “reactive conformance thesis” by focusing on how evaluated organizations may directly try to influence external stakeholders through public responses. The study is also one of the first that analytically disentangles how they may skillfully exploit different forms of “plasticity” that are inherent in any type of commensuration.