Rethinking Reproducibility as a Criterion for Research Quality

Including a Symposium on Mary Morgan: Curiosity, Imagination, and Surprise

ISBN: 978-1-78756-424-4, eISBN: 978-1-78756-423-7

ISSN: 0743-4154

Publication date: 24 October 2018

Abstract

A heated debate surrounds the significance of reproducibility as an indicator for research quality and reliability, with many commentators linking a “crisis of reproducibility” to the rise of fraudulent, careless, and unreliable practices of knowledge production. Through the analysis of discourse and practices across research fields, I point out that reproducibility is not only interpreted in different ways, but also serves a variety of epistemic functions depending on the research at hand. Given such variation, I argue that the uncritical pursuit of reproducibility as an overarching epistemic value is misleading and potentially damaging to scientific advancement. Requirements for reproducibility, however they are interpreted, are one of many available means to secure reliable research outcomes. Furthermore, there are cases where the focus on enhancing reproducibility turns out not to foster high-quality research. Scientific communities and Open Science advocates should learn from inferential reasoning from irreproducible data, and promote incentives for all researchers to explicitly and publicly discuss (1) their methodological commitments, (2) the ways in which they learn from mistakes and problems in everyday practice, and (3) the strategies they use to choose which research components of any project need to be preserved in the long term, and how.

Keywords

Citation

Sabina Leonelli (2018). 'Rethinking Reproducibility as a Criterion for Research Quality', Including a Symposium on Mary Morgan: Curiosity, Imagination, and Surprise (Research in the History of Economic Thought and Methodology, Volume 36B). Emerald Publishing Limited, pp. 129-146

Download as .RIS

DOI

: https://doi.org/10.1108/S0743-41542018000036B009

Publisher

:

Emerald Publishing Limited

Copyright © 2018 Emerald Publishing Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.