Search results

This study aims to explore ways of developing, implementing and validating a new framework and criteria for self-evaluation of programme curricula, with specific reference to the quality assurance certification process in a particular case.

The framework is developed using a case study research methodology and implemented based on criteria extraction through the triangulation of indicators achieved from internal goals and external directives.

The findings reveal that this is an improvement-led framework that can be adapted to other contexts during the quality assurance processes to facilitate periodical programme evaluations with a focus on the curriculum.

The proposed practical tool is developed for the programme evaluation process with a curricular focus during the quality assurance certification process of an interior architectural programme while enlightening the processes for the periodical self-evaluations of other institutions. The framework depends on both institution-specific internal and external directives and fulfilling curriculum-related criteria of the European Standards and Guidelines for Quality Assurance.

Within quality assurance processes, despite external quality assurance mechanisms, there is a shortage of self-evaluation tools for internal quality assurance procedures, which allow the dissociation of programme-specific qualities. The proposed framework is developed as an example of a self-tailored internal quality assurance tool and process for educational institutions to reveal their unique qualities.

This paper describes the development of an evaluation framework to document the process, impact and outcomes of a community‐based mental health promotion project. This initiative, the Rural Mental Health Project, is concerned with the promotion of positive mental health in rural communities in the Republic and Northern Ireland. As a community‐based initiative, this project involves multi‐component interventions that are implemented with diverse target groups across a range of community settings. Assessing the process of programme implementation is critical in order to capture and document the realities of programme planning and implementation. The evaluation approach adopted in this project is based on a logic model research paradigm (Scheirer et al, 1995). This model gives equal emphasis to process and outcome evaluation and seeks to relate the realities of programme implementation to intended programme outcomes. Project activity is tracked prospectively in order to examine the detail of actual programme delivery and its influence on expected project outcomes. This paper outlines the model as applied in this project and explores the methodological and practical challenges in evaluating complex community interventions.

Urban renewal through the regeneration and redevelopment of public housing estates has become a major policy initiative in most Australian state housing authorities since the mid-1990s. These policies have involved a mix of both physical renewal and community development in response to the problems that have emerged in the public housing sector over the past two decades. While the origins of these problems are well established and reflect the changes experienced by public housing sectors in other comparable countries (Hayward, 1996; Peel, 1995), the impact of policies to address these problems in the Australian context has attracted less attention in the academic literature (Arthurson, 1998; Randolph & Judd, 2000). While there is an emerging body of evaluation and research that has attempted to assess the outcomes of renewal programmes and policies, it can be argued that there is still a relatively poor level of general understanding of what aspects of renewal are effective or what outcomes have actually been achieved. At the same time, there has been little effective development of an exchange between researchers or evaluators on the effectiveness of the various evaluation methodologies – qualitative and quantitative – that have been used to assess renewal policies. This is particularly evident at the national level (Spiller Gibbin Swan, 2000).

It has become accepted practice to include an evaluation alongside learning programmes that take place at work, as a means of judging their effectiveness. There is a tendency to focus such evaluations on the relevance of the intervention and the amount of learning achieved by the individual. The aim of this review is to examine existing evaluation frameworks that have been used to evaluate education interventions and, in particular, assess how these have been used and the outcomes of such activity.

A scoping review using Arskey and O’Malley’s five stage framework was undertaken to examine existing evaluation frameworks claiming to evaluate education interventions.

Forty five articles were included in the review. A majority of papers concentrate on learner satisfaction and/or learning achieved. Rarely is a structured framework mentioned, or detail of the approach to analysis cited. Typically, evaluations lacked baseline data, control groups, longitudinal observations and contextual awareness.

This review has implications for those involved in designing and evaluating work-related education programmes, as it identifies areas where evaluations need to be strengthened and recommends how existing frameworks can be combined to improve how evaluations are conducted.

This scoping review is novel in its assessment and critique of evaluation frameworks employed to evaluate work-related education programmes.

The purpose of this paper is to describe the evolving IFLA approach to impact evaluation through three of its international programmes: Freedom of Access to Information, Building Strong Library Associations (BSLA) and the International Advocacy Programme (IAP). This review positions these three programmes within the wider discourse of the international evaluation community.

Each of the three programmes is considered in turn to show what they were trying to achieve and how thinking about impact evaluation at IFLA is evolving.

This paper reports key evaluation findings for relevant phases of the BSLA and IAP programmes in general terms.

The views presented are those of the evaluation consultants who advised each of these programmes (and in the cases of BSLA and the IAP conducted the programme evaluations).

The processes described and the conclusions drawn should be of interest to anyone involved in international or national library evaluation, especially of public libraries, library associations and national libraries.

The paper suggests that more systematic impact evaluation of public libraries, library associations and national libraries is necessary to ensure their future survival.

The authors were uniquely placed to see and participate in IFLA impact evaluation discussions over the past decade.

Entrepreneurship education is being taught to undergraduates in tertiary institutions and fresh graduates in youth programmes to encourage start-ups and create employment as a strategy to stem youth unemployment. As such, entrepreneurship education programmes are expected to include rigorous processes of programme design, implementation and evaluation so as to achieve changes in behaviour, attitude and action of participants measureable in terms of start-up and jobs created. Two entrepreneurship education programmes implemented in Nigeria are evaluated to ascertain the level of effectiveness in design, implementation and evaluation and the outcomes in terms of start-ups and employment created. Research methods adopted in the two programmes combine observation techniques with content analyses, action research in case study and focus group interviews. In addition, test-retest techniques in a quasi-experimental design, with a structured questionnaire is adopted in programme number two only. The findings are that while it is suspected that the design stage is jumped in programme number one, in programme two, the design is poorly done. Implementation is ineffective in the two programmes because objectives did not arise from programme design as they ought to and evaluation methods are inappropriate and so ineffective. The recommendations include review of the design of the two programmes to generate appropriate and measurable objectives; adopting implementation strategies that will achieve the measurable objectives generated from revised programme designs and adopting appropriate evaluation techniques that has capacity to measure outcomes and impact in addition to outputs.

All educators should reflect on and assess the quality of their teaching and their learning programmes. Such reflection is the subject of this article. The focus is on higher education (HE) with particular emphasis on distance learning institutions. A particular educational programme is considered, namely a course‐work Master's degree in environmental education at a South African distance learning university. Sustainable living is one of the envisaged outcomes of this programme. This article gives a general perspective on quality assurance in HE. The views of a number of authors are discussed, with special reference to HE in the cultural diversity of South Africa. Various approaches and factors that influence learning assessment are discussed. The theme of sustainability as integrated in HE programmes is emphasised as one of the criteria that should determine quality in education programmes. It is concluded that, although programme assessment is a difficult process and necessarily contextualised, it is an important tool for ensuring quality teaching and learning. Programme assessment is a form of critical self‐evaluation that includes peer evaluation and evaluative input from students.

Obesity in children and adolescents is a significant public health concern. The World Health Organization Health Promoting Schools (HPS) framework promotes good nutrition and physical activity in school settings. While HPS is embraced globally, effective implementation and sustainable programmes are a continued challenge. This paper aims to report on the characteristics of current school interventions based on HPS and implementation barriers and enablers.

A literature search identified peer-reviewed studies of school health interventions reflective of the HPS framework focusing on obesity prevention. Studies from all countries were included, if conducted in primary and/or secondary schools; included a sufficient amount of qualitative implementation or process evaluation data to draw conclusions regarding key barriers and enablers to implementation; and were published in English.

Nine interventions (n = 9) from seven countries were included. Most were implemented in primary schools and focused on specific grade levels. Engaging parents, the home environment, teacher time constraints, fun interventions, student participation, teacher training, integration with the curriculum and stakeholder engagement all emerged as strong implementation themes. Teachers as role models, establishing community partnerships and policy support also emerged as common themes.

Future interventions may benefit from enhancing teacher and parent health promotion. Partnerships with initiatives focusing on environmental sustainability may simultaneously benefit human and planetary health while strengthening stakeholder engagement opportunities and consistent messaging throughout the community. More comprehensive evaluation data are needed, in particular, for long-term HPS initiatives.

Calls for the development and dissemination of evidence-based programs to support children and families have been increasing for decades, but progress has been slow. This paper aims to argue that a singular focus on evaluation has limited the ways in which science and research is incorporated into program development, and advocate instead for the use of a new concept, “scientific accompaniment,” to expand and guide program development and testing.

A heuristic is provided to guide research–practice teams in assessing the program’s developmental stage and level of evidence.

In an idealized pathway, scientific accompaniment begins early in program development, with ongoing input from both practitioners and researchers, resulting in programs that are both effective and scalable. The heuristic also provides guidance for how to “catch up” on evidence when program development and science utilization are out of sync.

While implementation models provide ideas on improving the use of evidence-based practices, social service programs suffer from a significant lack of research and evaluation. Evaluation resources are typically not used by social service program developers and collaboration with researchers happens late in program development, if at all. There are few resources or models that encourage and guide the use of science and evaluation across program development.