To read the full version of this content please select one of the options below:

Do PISA data justify PISA-based education policy?

Luisa Araujo (Department of Human Capital and Employment, European Commission Joint Research Centre Ispra Sector, Ispra, Italy)
Andrea Saltelli (University of Bergen, Bergen, Norway) (Universitat Autonoma de Barcelona, Barcelona, Spain)
Sylke V. Schnepf (Competence Centre on Microeconomic Evaluation, European Commission Joint Research Centre Ispra Sector, Ispra, Italy)

International Journal of Comparative Education and Development

ISSN: 2396-7404

Article publication date: 13 February 2017

Abstract

Purpose

Since the publication of its first results in 2000, the Programme for International Student Assessment (PISA) implemented by the OECD has repeatedly been the subject of heated debate. In late 2014 controversy flared up anew, with the most severe critics going so far as to call for a halt to the programme. The purpose of this paper is to discuss the methodological design of PISA and the ideological basis of scientific and policy arguments invoked for and against it.

Design/methodology/approach

The authors examine the soundness of the survey methodology and identify the conflicting interpretations and values fuelling the debate.

Findings

The authors find that while PISA has promoted the focus on the important subject of children's education worldwide there are legitimate concerns about what PISA measures, and how. The authors conclude that the OECD should be more transparent in the documentation of the methodological choices that underlie the creation of the data and more explicit about the impact of these choices on the results. More broadly, the authors advise caution in the attempt to derive and apply evidence-based policy in the domain of education; the authors furthermore propose an alternative model of social inquiry that is sensitive and robust to the concerns of the various actors and stakeholders that may be involved in a given policy domain.

Originality/value

The issues and tensions surrounding the PISA survey can be better understood in the framework of post-normal science (PNS), the application of which to the PISA controversy offers a potential solution to a stalemate.

Keywords

Acknowledgements

The views expressed are purely those of the writers and may not under any circumstances be regarded as stating an official position of the European Commission.

Citation

Araujo, L., Saltelli, A. and Schnepf, S.V. (2017), "Do PISA data justify PISA-based education policy?", International Journal of Comparative Education and Development, Vol. 19 No. 1, pp. 20-34. https://doi.org/10.1108/IJCED-12-2016-0023

Publisher

:

Emerald Publishing Limited

Copyright © 2017, Emerald Publishing Limited