Search results

Intervention evaluations have not always accounted for long-term implementation of interventions. The purpose of this paper is to explore implementation of a primary care intervention during the lifespan of the trial and beyond.

Eight general practices participated in the trial (four control and four intervention). In-depth interviews (with nine GPs and four practices nurses who delivered the intervention) and observation methods were employed. Thematic analysis was utilized and Normalization Process Theory (NPT) constructs were compared with emergent themes.

Macro-level policy imperatives shaped practice priorities which resulted in the “whole system” new intervention not being perceived to be sustainable. Continued routinization of the intervention into usual care beyond the lifespan of the funded study was dependent on individualized monitoring and taking forward tacit knowledge.

The authors discuss the implications of these findings for sociological theories of implementation and understanding outcomes of research led complex interventions.

The study describes the complex interplay between macro processes and individual situated practices and contributes to understanding if, how, and why interventions are sustained beyond initial “research push”. The value of the study lies in describing the conditions and potential consequences of long-term implementation, which might be translated to other contexts.

The teaching of cooking is an important aspect of school-based efforts to promote healthy diets among children, and is frequently done by external agencies. Within a limited evidence base relating to cooking interventions in schools, there are important questions about how interventions are integrated within school settings. The purpose of this paper is to examine how a mobile classroom (Cooking Bus) sought to strengthen connections between schools and cooking, and drawing on the concept of the sociotechnical network, theorise the interactions between the Bus and school contexts.

Methods comprised a postal questionnaire to 76 schools which had received a Bus visit, and case studies of the Bus’ work in five schools, including a range of school sizes and urban/rural locations. Case studies comprised observation of Cooking Bus sessions, and interviews with school staff.

The Cooking Bus forged connections with schools through aligning intervention and schools’ goals, focussing on pupils’ cooking skills, training teachers and contributing to schools’ existing cooking-related activities. The Bus expanded its sociotechnical network through post-visit integration of cooking activities within schools, particularly teachers’ use of intervention cooking kits.

The paper highlights the need for research on the long-term impacts of school cooking interventions, and better understanding of the interaction between interventions and school contexts.

This paper adds to the limited evidence base on school-based cooking interventions by theorising how cooking interventions relate to school settings, and how they may achieve integration.

This paper evaluates the implementation of a school-based physical activity intervention and discusses how the intervention outcomes can be influenced by the implementation.

In four of the nine lower secondary schools in which the intervention was conducted, the authors examined implementation fidelity, adaptation, quality, responsiveness and dose received. The authors conducted focus group interviews with teachers (n = 8) and students (n = 46) and made observations. Dose delivered was examined quantitatively, with weekly registrations.

Results showed that two out of four schools made few and positive adaptations, implemented the intervention with high fidelity and quality and responded positively. Four main factors were found to influence implementation: frame factors, intervention characteristics, participant characteristics and provider characteristics.

A cross-sectional design was used and may not represent implementation throughout the whole school year.

In terms of large-scale implementation, the intervention may be generalizable. However, intervention criteria such as adequate facilities and a flexible timetable may be unattainable for some schools. The intervention can be adapted without compromising its purpose, but adaptations should be a result of cooperation between students and teachers.

Process evaluations on this topic are rare. This study adds to a limited knowledge base concerning what factors may influence implementation of school-based physical activity interventions for adolescents.

There are five factors acting as a barrier to the effective evaluation of educational technology (edtech), which are as follows: premature timing, inappropriate techniques, rapid change, complexity of context and inconsistent terminology. The purpose of this paper is to identify new evaluation approaches that will address these and reflect on the evaluation imperative for complex technology initiatives.

An initial investigation of traditional evaluative approaches used within the technology domain was broadened to investigate the evaluation practices within social and public policy domains. Realist evaluation, a branch of theory-based evaluation, was identified and reviewed in detail. The realist approach was then refined, proposing two additional necessary steps to support mapping the technical complexity of initiatives.

A refined illustrative example of a realist evaluation framework is presented, including two novel architectural edtech domain reference models to support mapping.

Recommendations include building individual evaluator capacity; adopting the realist framework; the use of architectural edtech domain reference models; phased evaluation to first build theories in technology “context” and then iteratively during complex implementation chains; and community contribution to a shared map of technical and organisational complexity.

This paper makes a novel contribution by arguing the imperative for a theory-based realist approach to help redefine evaluative thinking within the IT and complex system domain. It becomes an innovative proposal with the addition of two domain reference models that tailor the approach for edtech. Its widespread adoption will help build a shared evidence base that synthesizes and surfaces “what works, for whom, in which contexts and why”, benefiting educators, IT managers, funders, policymakers and future learners.

The purpose of this paper is to discuss three potential contributions from implementation science that can help clinicians and researchers to design and evaluate more effective integrated care programmes for older people with frailty.

This viewpoint paper focuses on three contributions: stakeholder engagement, using implementation science frameworks, and assessment of implementation strategies and outcomes.

Stakeholder engagement enhances the acceptability of interventions to recipients and providers and improves reach and sustainability. Implementation science frameworks assess provider, recipient and wider context factors enabling and hindering implementation, and guide selection and tailoring of appropriate implementation strategies. The assessment of implementation strategies and outcomes enables the evaluation of the effectiveness and implementation of integrated care programmes for this population.

Implementation science provides a systematic way to think about why integrated care programmes for older people with frailty are not implemented successfully. The field has an evidence base, including how to tailor implementation science strategies to the local setting, and assess implementation outcomes to provide clinicians and researchers with an understanding of how their programme is working. The authors draw out implications for policy, practice and future research.

Different models to deliver integrated care to support older people with frailty exist, but it is not known which is most effective, for which individuals and in which clinical or psychosocial circumstances. Implementation science can play a valuable role in designing and evaluating more effective integrated care programmes for this population.

The purpose of this paper is to explore the process of involving students and staff on school action groups, and staff and student experiences of reviewing local data and initiating school-level changes, to address bullying and other aggression.

The authors draw on qualitative, process data collected at four purposively sampled pilot intervention schools in England via semi-structured interviews with school managers, action group members and facilitators (n=33), focus groups with students (n=16) and staff (n=4), and observations.

School staff used multiple methods to recruit a diverse range of students onto school action groups. Locally tailored data reports were an important catalyst for action groups to identify priorities and plan whole school change – both through the process of “validation” (whereby existing concerns were confirmed) and “discovery” (whereby new problems were identified). An unexpected benefit of providing schools with these data was that it triggered analyses of other data sources, including routine monitoring data. External facilitators were important in promoting student voice and ensuring the intervention retained integrity as a whole-school restorative approach.

It was feasible to involve young people using action groups, and there was evidence of school-level actions led by students, including in disadvantaged school contexts. Future Health Promoting Schools interventions could incorporate this approach to support locally appropriate, school-level change.

The micro-level processes that were observed, whereby action groups interrogated feedback reports and collected additional data, suggest the responsiveness of such youth-involvement interventions to local needs. Contrary to many public health interventions, implementation appeared to be facilitated rather than hindered by features of the secondary-school “market” whereby parents have some choice between schools.

The purpose of this paper is to present a research method which offers insights into the factors which affect the optimal use and implementation of telecare, or which may lead to its rejection by older people with support needs – factors pertinent to those involved in the design and delivery of both telecare research studies and of services.

The methodology outlined, influenced by Chicago School and Science and Technology Studies, emphasises the importance of context when examining social phenomena, such as the use of technology. The multi-method approach identified key patterns which provide insights into how telecare was used by a sample of older adults, including information on its suboptimal use and rejection.

The study of telecare use in real-life situations – and the investigation of other complex social interventions – requires an approach which fully considers the importance of context in explaining social phenomena. The main value of the method and findings lies in the insights offered to designers of larger studies which seek to generalise results, including telecare randomised control trials, as well as for those involved in the delivery of telecare services to achieve optimal adoption and use.

The study methods described combined ethnographic, longitudinal and qualitative methodologies and creative research tools in an innovative way to allow exploration of how context affects the uptake and use of telecare.

Adapting the Health Promotion School (HPS) approach to context specifics is acknowledged as being essential for implementation and achieving optimal effectiveness. This study aims to explore implementation variations on seven HPS spectra (such as top-down to bottom-up involvement of stakeholders) on which implementation of the HPS approach can vary, and the factors that relate to navigation on these spectra.

In 2020, fourteen HPS researchers and professionals from ten European countries participated in semi-structured interviews.

Navigation variations on the HPS spectra occurred throughout most spectra. Further, a tendency was found towards spectrum extremes of addressing multiple core-components, implementing non-disruptive Health Promotion (HP) programmes, and evaluating the HPS approach through an action-oriented research approach. Important general factors were resources, staff capacity and time available to staff members for implementing the HPS approach. Some spectra required more specific factors like organisational skills, leadership or a certain level of democracy.

The implementation of the HPS approach should be supported by implementation strategies addressing the spectrum-specific factors, but more generic factors such as staff capacity, resources and the level of democracy should also be considered.

This study explores navigation variations throughout HPS spectra rather than the HPS approach in general. It also nuances implementation diversity across and within different European contexts.