New frontiers in cognitive ability testing: working memory
Journal of Managerial Psychology
ISSN: 0268-3946
Article publication date: 24 January 2020
Issue publication date: 19 August 2020
Abstract
Purpose
Cognitive ability tests demonstrate strong relationships with job performance, but have several limitations; notably, subgroup differences based on race/ethnicity. As an alternative, the purpose of this paper is to develop a working memory assessment for personnel selection contexts.
Design/methodology/approach
The authors describe the development of Global Adaptive Memory Evaluation (G.A.M.E.) – a working memory assessment – along with three studies focused on refining and validating G.A.M.E., including examining test-taker reactions, reliability, subgroup differences, construct and criterion-related validity, and measurement equivalence across computer and mobile devices.
Findings
Evidence suggests that G.A.M.E. is a reliable and valid tool for employee selection. G.A.M.E. exhibited convergent validity with other cognitive assessments, predicted job performance, yielded smaller subgroup differences than traditional cognitive ability tests, was engaging for test-takers, and upheld equivalent measurement across computers and mobile devices.
Research limitations/implications
Additional research is needed on the use of working memory assessments as an alternative to traditional cognitive ability testing, including its advantages and disadvantages, relative to other constructs and methods.
Practical implications
The findings illustrate working memory’s potential as an alternative to traditional cognitive ability assessments and highlight the need for cognitive ability tests that rely on modern theories of intelligence and leverage burgeoning mobile technology.
Originality/value
This paper highlights an alternative to traditional cognitive ability tests, namely, working memory assessments, and demonstrates how to design reliable, valid, engaging and mobile-compatible versions.
Keywords
Acknowledgements
The authors are grateful for the guidance of working memory expert, Randy Engle, PhD, and of Aon’s Science Advisory Board during the development of G.A.M.E., and also for the insights of two anonymous reviewers, whose feedback helped shape the current paper.
Citation
Martin, N., Capman, J., Boyce, A., Morgan, K., Gonzalez, M.F. and Adler, S. (2020), "New frontiers in cognitive ability testing: working memory", Journal of Managerial Psychology, Vol. 35 No. 4, pp. 193-208. https://doi.org/10.1108/JMP-09-2018-0422
Publisher
:Emerald Publishing Limited
Copyright © 2020, Emerald Publishing Limited