Predictive validity of evidence-based practices in supported employment: a systematic review and meta-analysis

Helen Lockett (Department of Psychological Medicine, School of Medicine, The University of Auckland, Auckland, New Zealand) (Strategic Policy Advisor at The Wise Group, Hamilton, New Zealand)
Geoffrey Waghorn (Queensland Centre for Mental Health Research (QCMHR), The Park Centre for Mental Health, Brisbane, Australia) (Associate Professor (adjunct) with the School of Applied Psychology, Griffith University, Brisbane, Australia)
Rob Kydd (Department of Psychological Medicine, School of Medicine, The University of Auckland, Auckland, New Zealand)
David Chant (Launceston, Australia)

Mental Health Review Journal

ISSN: 1361-9322

Publication date: 12 December 2016

Abstract

Purpose

The purpose of this paper is to explore the predictive validity of two measures of fidelity to the individual placement and support (IPS) approach to supported employment.

Design/methodology/approach

A systematic review and meta-analysis was conducted of IPS programs. In total, 30 studies provided information characterizing 69 cohorts and 8,392 participants. Predictive validity was assessed by a precision and negative prediction analysis and by multivariate analysis of deviance.

Findings

Fidelity scores on the IPS-15 scale of 60 or less accurately predicted poor outcomes, defined as 43 percent or less of participants commencing employment, in 100 percent of cohorts. Among cohorts with IPS-15 fidelity scores of 61-75, 63 percent attained good employment outcomes defined as 44 percent or more commencing employment. A similar pattern emerged from the precision analysis of the smaller sample of IPS-25 cohorts. Multivariate analysis of deviance for studies using the IPS-15 scale examined six cohort characteristics. Following adjustment for fidelity score, only fidelity score (χ2=15.31, df=1, p<0.001) and author group (χ2=35.01, df=17, p=0.01) representing an aspect of cohort heterogeneity, remained associated with commencing employment.

Research limitations/implications

This study provides evidence of moderate, yet important, predictive validity of the IPS-15 scale across diverse international and research contexts. The smaller sample of IPS-25 studies limited the analysis that could be conducted.

Practical implications

Program implementation leaders are encouraged to first focus on attaining good fidelity, then supplement fidelity monitoring with tracking the percentage of new clients who obtain a competitive job employment over a pre-defined period of time.

Originality/value

The evidence indicates that good fidelity may be necessary but not sufficient for good competitive employment outcomes.

Keywords

Citation

Lockett, H., Waghorn, G., Kydd, R. and Chant, D. (2016), "Predictive validity of evidence-based practices in supported employment: a systematic review and meta-analysis", Mental Health Review Journal, Vol. 21 No. 4, pp. 261-281. https://doi.org/10.1108/MHRJ-12-2015-0040

Download as .RIS

Publisher

:

Emerald Group Publishing Limited

Copyright © 2016, Emerald Group Publishing Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.
Contact us
To rent this content from Deepdyve, please click the button.
Rent from Deepdyve