Understanding validity and fairness issues in high-stakes individual testing situations

Jade Caines (Department of Education, University of New Hampshire, Durham, New Hampshire, USA)
Beatrice L. Bridglall (Secondary and Special Education, Montclair State University, Montclair, New Jersey, USA)
Madhabi Chatterji (Organization and Leadership, Teachers College, Columbia University, New York, NY, USA)

Quality Assurance in Education

ISSN: 0968-4883

Publication date: 28 January 2014

Abstract

Purpose

This policy brief discusses validity and fairness issues that could arise when test-based information is used for making “high stakes” decisions at an individual level, such as, for the certification of teachers or other professionals, or when admitting students into higher education programs and colleges, or for making immigration-related decisions for prospective immigrants. To assist test developers, affiliated researchers and test users enhance levels of validity and fairness with these particular types of test score interpretations and uses, this policy brief summarizes an “argument-based approach” to validation given by Kane.

Design/methodology/approach

This policy brief is based on a synthesis of conference proceedings and review of selected pieces of extant literature. To that synthesis, the authors add practitioner-friendly examples with their own analysis of key issues. They conclude by offering recommendations for test developers and test users.

Findings

The authors conclude that validity is a complex and evolving construct, especially when considering issues of fairness in individual testing contexts. Kane's argument-based approach offers an accessible framework through which test makers can accumulate evidence to evaluate inferences and arguments related to decisions to be made with test scores. Perspectives of test makers, researchers, test takers and decision-makers must all be incorporated into constructing coherent “validity arguments” to guide the test development and validation processes.

Originality/value

Standardized test use for individual-level decisions is gradually spreading to various regions of the world, but understandings of validity are still uneven among key stakeholders of such testing programs. By translating complex information on test validation, validity and fairness issues with all concerned stakeholders in mind, this policy brief attempts to address the communication gaps noted to exist among these groups by Kane.

Keywords

Citation

Caines, J., L. Bridglall, B. and Chatterji, M. (2014), "Understanding validity and fairness issues in high-stakes individual testing situations", Quality Assurance in Education, Vol. 22 No. 1, pp. 5-18. https://doi.org/10.1108/QAE-12-2013-0054

Download as .RIS

Publisher

:

Emerald Group Publishing Limited

Copyright © 2014, Authors

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.
To rent this content from Deepdyve, please click the button.