Search results

Models of integrated care are prime examples of complex interventions, incorporating multiple interacting components that work through varying mechanisms to impact numerous outcomes. The purpose of this paper is to explore summative, process and developmental approaches to evaluating complex interventions to determine how to best test this mess.

This viewpoint draws on the evaluation and complex intervention literatures to describe the advantages and disadvantages of different methods. The evaluation of the electronic patient reported outcomes (ePRO) mobile application and portal system is presented as an example of how to evaluate complex interventions with critical lessons learned from this ongoing study.

Although favored in the literature, summative and process evaluations rest on two problematic assumptions: it is possible to clearly identify stable mechanisms of action; and intervention fidelity can be maximized in order to control for contextual influences. Complex interventions continually adapt to local contexts, making stability and fidelity unlikely. Developmental evaluation, which is more conceptually aligned with service-design thinking, moves beyond these assumptions, emphasizing supportive adaptation to ensure meaningful adoption.

Blended approaches that incorporate service-design thinking and rely more heavily on developmental strategies are essential for complex interventions. To maximize the benefit of this approach, three guiding principles are suggested: stress pragmatism over stringency; adopt an implementation lens; and use multi-disciplinary teams to run studies.

This viewpoint offers novel thinking on the debate around appropriate evaluation methodologies to be applied to complex interventions like models of integrated care.

Football exercise as an intervention for people with severe mental health problems has seen an increasing interest in the past years. To date, there is, however, no comprehensive review of the empirical evidence regarding the effectiveness of these interventions. In this review, the authors have comprised the research findings from the peer-review literature as well as the theoretical approaches to football exercise as an adjunct treatment. This overview will be informative to everybody who is planning to develop a football intervention for this population as well as to the people who are preparing evaluation studies that measure the effectiveness of such interventions. The paper aims to discuss these issues.

The authors identified research papers in the peer-review literature that feature empirical findings on “football interventions” that aim at improving mental and/or physical well-being in participants with mental health problems. The authors are using the term “football intervention” here in the sense that the participants actively took part in football exercise, so the authors excluded studies in which the participants only watched football or used football as a metaphor to discuss mental health problems. In a table, the authors indicate the definition of the target group, targeted outcomes, measured outcomes, form and frequency of the intervention as well as the research method(s).

The authors identified 16 studies on 15 projects. The majority of studies were qualitative and had positive findings in which the participants reported increased well-being and connectedness, elevation of symptoms and improved physical well-being. The outcomes of the quantitative studies, however, were mixed with some results suggesting that not all intended goals were achieved. There seems to be a need for more quantitative studies to triangulate the qualitative findings. Interestingly, most interventions take place in the UK. Many studies fail to give detailed methodological information and often the aims of the interventions are vague or not stated at all.

Due to the heterogeneity of the studies and relative scarcity of evaluation projects on football interventions for people with mental health problems, the authors could not conduct an in-depth systematic review. Furthermore, the information on methods was often unsatisfying and despite efforts to get more detailed input from the authors of cited papers, those gaps could not always be filled. Instead of coming up with a crystal-clear summary of whether and how football interventions work for everybody, topics were identified that need to be addressed in the planning of interventions, in evaluation studies, in implementation efforts and in the theoretical discourse.

This paper constitutes a helpful overview for everybody who is interested in the theoretical background of football interventions for people with mental health problems, for people who are planning to develop respective interventions, for researchers who engage in evaluation projects that look into the effectiveness of football interventions (or similar exercise interventions) as well as for the people who are interested in how football interventions can be implemented. This paper is likely to make a contribution to the advancement of alternative exercise interventions that aim at improving mental, physical and social health in people with mental health problems.

This paper will help putting the topic of football interventions (and similar, alternative exercise interventions) further up on the public health agenda by providing an overview of the empirical evidence at hand and by specifying advantages of the approach as well as pointing out actions that need to be taken to make football a recognised, evidence based and viable option for adjunct mental health treatment that is attractive to potential participants as well as funders as well as to the potential participants.

There is no comprehensive summary to date that provides a (reasonably) systematic overview of empirical findings for football interventions for people with MH problems. Furthermore, the literature on the theoretical background of these interventions has been somewhat patchy and heterogonous. This paper aims at filling both these gaps and identifies the issues that need to be covered in the planning of respective interventions and evaluations. This paper will be useful to everybody who is developing football interventions (or similar alternative adjunct exercise interventions), who is conducting evaluation research in this area and who is interested in the implementation of football interventions.

The purpose of this paper is twofold: first, to take stock of the current state of knowledge about inclusive value-chain development (VCD) in the context of international agricultural research; and second, to draw out the implications for future research and action.

This paper is based on a review of recent research papers authored by professionals affiliated with international agricultural research centers and their partners in Africa, Asia, and Latin America.

The studies reviewed in the paper identify the opportunities emerging from new and expanding markets for agricultural products and challenges to smallholder participation in these markets. It identifies key attributes of successful value-chain interventions, emphasizing the importance of combining value-chain approaches with other approaches, including those emerging from innovation systems and rural livelihoods frameworks. Methods are offered for evaluating complex value-chain interventions.

The paper summarizes the state of knowledge as of early 2016 in a dynamic field. Important contributions to knowledge may have been made since then.

The paper summarizes the state of knowledge in the field, and identifies emerging issues and policy implications, knowledge gaps, and priorities for future applied research.

This paper evaluates the implementation of a school-based physical activity intervention and discusses how the intervention outcomes can be influenced by the implementation.

In four of the nine lower secondary schools in which the intervention was conducted, the authors examined implementation fidelity, adaptation, quality, responsiveness and dose received. The authors conducted focus group interviews with teachers (n = 8) and students (n = 46) and made observations. Dose delivered was examined quantitatively, with weekly registrations.

Results showed that two out of four schools made few and positive adaptations, implemented the intervention with high fidelity and quality and responded positively. Four main factors were found to influence implementation: frame factors, intervention characteristics, participant characteristics and provider characteristics.

A cross-sectional design was used and may not represent implementation throughout the whole school year.

In terms of large-scale implementation, the intervention may be generalizable. However, intervention criteria such as adequate facilities and a flexible timetable may be unattainable for some schools. The intervention can be adapted without compromising its purpose, but adaptations should be a result of cooperation between students and teachers.

Process evaluations on this topic are rare. This study adds to a limited knowledge base concerning what factors may influence implementation of school-based physical activity interventions for adolescents.

Involvement of parents/carers may increase effectiveness of primary school-based alcohol-misuse prevention projects through strengthening family-based protective factors, but rates of parental engagement are typically low. This paper reports findings from an exploratory trial of a school-based prevention intervention – Kids, Adults Together (KAT), based on the Social Development Model, which aimed to promote pro-social family communication in order to prevent alcohol misuse, and incorporated strategies to engage parents/carers. The purpose of this paper is to assess the feasibility and value of conducting an effectiveness trial of KAT.

The study was a parallel-group cluster randomised exploratory trial with an embedded process evaluation. The study took place in south Wales, UK, and involved nine primary schools, 367 pupils in Years 5/6 (aged 9-11 years) and their parents/carers and teachers. Questionnaires were completed by pupils at baseline and four month follow-up, and by parents at six month follow-up.

Overall KAT was delivered with good fidelity, but two of five intervention schools withdrew from the study without completing implementation. In total, 50 per cent of eligible parents participated in the intervention, and KAT had good acceptability among pupils, parents and teachers. However, a number of “progression to effectiveness trial” criteria were not met. Intermediate outcomes on family communication (hypothesised to prevent alcohol misuse) showed insufficient evidence of an intervention effect. Difficulties were encountered in identifying age appropriate outcome measures for primary school-age children, particularly in relation to family communication processes. The study was unable to find comprehensive methodological guidance on exploratory trials.

It would not be appropriate to conduct an effectiveness trial as key progression criteria relating to intervention and trial feasibility were not met. There is a need for new measures of family communication which are suitable for primary school-age children, and more guidance on the design and conduct of exploratory/feasibility trials.

KAT achieved high rates of parental involvement, and its theoretical framework and processes could be adapted by other interventions which experience difficulties with recruitment of parents/carers.

The purpose of this study is to describe the implementation of a digital-based team coaching intervention aimed at improving team communication in the workplace through social network visualization. The study examined recipients’ perceptions of the intervention at two time points and assessed the temporal stability of various factors, including the intervention’s integrity, design, transferability, acceptance and the usability of the adopted visualization tool. The moderating role of digital usability was also evaluated.

Four team coaching sessions were delivered to 62 participants from seven teams across three departments within a large public health-care organization in Northern Italy. Perceptions of the intervention dimensions were collected after the second and fourth sessions.

Results indicated that, at both time points, recipients appreciated the intervention’s integrity and usability more than its design, transferability and acceptance. Furthermore, no significant changes in recipients’ perceptions were observed over time. The transferability of the intervention was significantly associated with its acceptance, but only when the usability of the digital tool was high.

The study enriches existing literature on digital interventions in group communication by focusing on process dimensions like recipients’ perceptions of various aspects and the implementation process. Furthermore, the study underscores the potential of integrating specific techniques such as sociomapping and coaching within health-care organizations, encouraging more research and development in these areas.

The study emphasizes the critical role of usability and integrity in digital-based team coaching interventions, suggesting that high-quality, user-friendly tools not only lead to initial effectiveness but also sustain positive impacts over time, while also increasing transferability and acceptance.

The present study uniquely deploys a longitudinal approach to examine recipients’ perceptions of a digital-based intervention that combines social network visualization and team coaching to enhance team communication.

Mental well-being is associated with positive outcomes throughout the life course. This study aims to examine interventions delivered by allied health professionals (AHPs) to alleviate community stressors adversely impacting public mental health and well-being.

Review inclusion criteria comprised experimental and qualitative process evaluations of public mental health interventions delivered by AHPs. Electronic searches in Cinahl, Embase, Medline, PsycINFO and the Cochrane Library, were combined with grey literature searches of National Institute for Health and Care Excellence public health guidance. A narrative synthesis and the Effective Public Health Practice Project appraisal tool were used to evaluate the evidence.

A total of 45-articles were included in the review describing AHP-delivered interventions addressing social disadvantage, trauma, bullying, loneliness, work-related stress, transitional stress, intersectionality, pain and bereavement. No articles were identified evaluating interventions delivered by operating department practitioners or orthoptists. A conceptual map was developed summarising the stressors, and a typology of public mental health interventions defined including: place-based interventions, discrete/one-off interventions, multi-component lifestyle and social connector interventions and interventions targeting groups at risk of mental health conditions.

Many mental health conditions begin in childhood, and a strength of the review is the life course perspective. A further strength is compiling a compendium of public mental health outcome measures used by AHPs to inform future research. The authors excluded many articles focussed on clinical interventions/populations, which did not meet review inclusion criteria. While playing a key role in delivering public mental health interventions, clinical psychologists are not defined as AHPs and were excluded from the review, and this may be construed a limitation. Given heterogeneity of study designs and interventions evaluated numerical analyses of pooled findings was not appropriate.

The review highlights the breadth of community stressors on which AHPs can intervene and contribute in public mental health contexts, stressors which correspond to those identified in UK Government guidance as currently important and relevant to address. The findings can inform developing community public mental health pathways that align with the UK National Health Service (NHS) Long Term Plan, on prevention and early intervention to protect community mental health and well-being. Further can inform the NHS strategic direction for AHPs including informing ways of increasing utilisation of core AHP skills to optimise contributions in public mental health agendas.

It is surprising there were not more AHP delivered evaluations of interventions for other stressors important to address in public mental health settings, for example gambling, domestic violence or that used digital technology, and these are areas for future research. Future research should identify the most active/effective dimensions of multi-component interventions which could be informed by frameworks to guide complex intervention development. The relative paucity of research identified, highlights the predominant focus of research to date on interventions for clinical mental health conditions and populations. The lack of preventative approaches is evident, and an important area for future research to align with UK health and social care priorities.

The review highlights AHP-delivered interventions impacting diverse community stressors across the life course. The findings can inform developing public mental health pathways aligned with government health service priorities to protect mental health and well-being, prioritise prevention and early intervention and increase utilisation of AHP skills across public mental health settings.

The purpose of this paper is to analyze the evidence-based research strategy (EBRS) used to evaluate eight projects that applied the neighborhood approach for disaster risk reduction (NA-DRR) in informal urban settlements in Colombia, Guatemala, Haiti, Honduras, Jamaica and Peru, between 2012 and 2017.

The study covers the first five of the seven EBRS stages: first, identify relevant interventions; second, prepare evaluation questions; third, select evidence sources and implement a search strategy; fourth, appraise evidences and identify gaps; fifth, create an evaluation design to include an extensive literature review, followed by a mixed research method with surveys, focus groups and interviews; disaster risk modeling; georeferencing analysis; and engineering inspections. The last two stages: sixth, apply the evidence, and seventh, evaluate the evidence application, will be addressed in a near future.

Even though the reference to “evidence” is frequent in the DRR field, it is largely based on descriptive processes, anecdotal references, best practices, lessons learned and case studies, and particularly deficient on the subject of informal and precariousness settlements. The evaluation allowed a deep and broad analysis of NA-DRR in urban informal settlements, comparing it with other DRR strategies implemented by different stakeholders in fragile urban settings, assessing the effectiveness and sustainability of the various DRR interventions.

The abundant data, information and knowledge generated will serve as foundation for forthcoming thematic peer-reviewed publications informing evidence-based DRR research, policy and practice, with emphasis on informal and precariousness settlements in particular.

This paper aims to outline and evaluate a pilot partnership programme – an Occupational Therapy–led gymnastics group intervention for children aged eight to twelve with a diagnosis of attention deficit hyperactivity disorder (ADHD).

The overall aim of this programme was to increase participation in a valued leisure occupation. Based on the needs of the children, a physical-activity-based intervention was chosen that was challenging, novel and motivating. The intervention was then developed to target executive functioning and processing skills; enhance motor coordination skills; develop social skills; and primarily provide a positive experience. Seventeen children attended 75-minute sessions weekly for eight weeks. The programme was evaluated using non-standardised qualitative measures – parent, child and coach evaluation questionnaires were developed by the occupational therapist for this purpose.

Children engaged well in the programme with results showing increased participation and enjoyment of a new leisure occupation; improvement in social interaction levels and a sense of belonging; and development of motor and process skills. The results demonstrate the benefit of a partnership approach and suggest sustainability of the programme as well as the gains made.

The results of this evaluation suggest that the programme met its aims and supports further research into the efficacy of this type of partnership approach and intervention in supporting children with ADHD attending Child and Adolescent Mental Health Services.

This study aims to find ways to bridge the gap between workplace design and research. Exploring the design process from general design aims to site-specific design makes the process visible to support workplace design research.

Participatory design methods were used to understand employees’ needs and preferences in work-related situations to support the design process. The design process was divided into three phases. The office was temporarily refurbished for the intervention study, and evaluation data was collected with qualitative methods.

Participatory design-generated data revealed typical knowledge work needs, such as the need for privacy, interaction, exposure and preferences for the atmosphere in the workspaces during different situations. The authors identified the following key points to obtain design data: design aims, affordance design and site-specific multidimensional design. An intervention study in a small organisation revealed that lack of activity-supporting spaces created undesirable overlaps for focused work, collaborative work and client communication.

The findings of this paper are explorative and limited to a small knowledge work company. The present approach identifies valuable data collection points in different design phases of workplace design processes. Sharing knowledge from practice to research and vice versa could inform research and improve workplace design.

This study makes the workplace design phases more visible. It supports finding new ways to study the connection between the user-needs and workplaces; and understanding how different design solutions impact workplace experiences, such as satisfaction. This study also brings focus to understanding the versatile needs of small organisations and their workplace design.