Books and journals Case studies Expert Briefings Open Access
Advanced search

Predictive validity of evidence-based practices in supported employment: a systematic review and meta-analysis

Helen Lockett (Department of Psychological Medicine, School of Medicine, The University of Auckland, Auckland, New Zealand) (Strategic Policy Advisor at The Wise Group, Hamilton, New Zealand)
Geoffrey Waghorn (Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Brisbane, Australia) (Associate Professor (adjunct) with the School of Applied Psychology, Griffith University, Brisbane, Australia)
Rob Kydd (Department of Psychological Medicine, School of Medicine, The University of Auckland, Auckland, New Zealand)
David Chant (Launceston, Australia)

Mental Health Review Journal

ISSN: 1361-9322

Publication date: 12 December 2016

Abstract

Purpose

The purpose of this paper is to explore the predictive validity of two measures of fidelity to the individual placement and support (IPS) approach to supported employment.

Design/methodology/approach

A systematic review and meta-analysis was conducted of IPS programs. In total, 30 studies provided information characterizing 69 cohorts and 8,392 participants. Predictive validity was assessed by a precision and negative prediction analysis and by multivariate analysis of deviance.

Findings

Fidelity scores on the IPS-15 scale of 60 or less accurately predicted poor outcomes, defined as 43 percent or less of participants commencing employment, in 100 percent of cohorts. Among cohorts with IPS-15 fidelity scores of 61-75, 63 percent attained good employment outcomes defined as 44 percent or more commencing employment. A similar pattern emerged from the precision analysis of the smaller sample of IPS-25 cohorts. Multivariate analysis of deviance for studies using the IPS-15 scale examined six cohort characteristics. Following adjustment for fidelity score, only fidelity score (χ2=15.31, df=1, p<0.001) and author group (χ2=35.01, df=17, p=0.01) representing an aspect of cohort heterogeneity, remained associated with commencing employment.

Research limitations/implications

This study provides evidence of moderate, yet important, predictive validity of the IPS-15 scale across diverse international and research contexts. The smaller sample of IPS-25 studies limited the analysis that could be conducted.

Practical implications

Program implementation leaders are encouraged to first focus on attaining good fidelity, then supplement fidelity monitoring with tracking the percentage of new clients who obtain a competitive job employment over a pre-defined period of time.

Originality/value

The evidence indicates that good fidelity may be necessary but not sufficient for good competitive employment outcomes.

Keywords

  • Fidelity
  • Severe mental illness
  • Supported employment
  • Predictive validity
  • Evidence-based practices

Citation

Lockett, H., Waghorn, G., Kydd, R. and Chant, D. (2016), "Predictive validity of evidence-based practices in supported employment: a systematic review and meta-analysis", Mental Health Review Journal, Vol. 21 No. 4, pp. 261-281. https://doi.org/10.1108/MHRJ-12-2015-0040

Download as .RIS

Publisher

:

Emerald Group Publishing Limited

Copyright © 2016, Emerald Group Publishing Limited

Please note you do not have access to teaching notes

You may be able to access teaching notes by logging in via Shibboleth, Open Athens or with your Emerald account.
Login
If you think you should have access to this content, click the button to contact our support team.
Contact us

To read the full version of this content please select one of the options below

You may be able to access this content by logging in via Shibboleth, Open Athens or with your Emerald account.
Login
To rent this content from Deepdyve, please click the button.
Rent from Deepdyve
If you think you should have access to this content, click the button to contact our support team.
Contact us
Emerald Publishing
  • Opens in new window
  • Opens in new window
  • Opens in new window
  • Opens in new window
© 2021 Emerald Publishing Limited

Services

  • Authors Opens in new window
  • Editors Opens in new window
  • Librarians Opens in new window
  • Researchers Opens in new window
  • Reviewers Opens in new window

About

  • About Emerald Opens in new window
  • Working for Emerald Opens in new window
  • Contact us Opens in new window
  • Publication sitemap

Policies and information

  • Privacy notice
  • Site policies
  • Modern Slavery Act Opens in new window
  • Chair of Trustees governance statement Opens in new window
  • COVID-19 policy Opens in new window
Manage cookies

We’re listening — tell us what you think

  • Something didn’t work…

    Report bugs here

  • All feedback is valuable

    Please share your general feedback

  • Member of Emerald Engage?

    You can join in the discussion by joining the community or logging in here.
    You can also find out more about Emerald Engage.

Join us on our journey

  • Platform update page

    Visit emeraldpublishing.com/platformupdate to discover the latest news and updates

  • Questions & More Information

    Answers to the most commonly asked questions here