Reconciling the Small Effect of Rankings on University Performance with the Transformational Cost of Conformity

Abstract

University rankings and metrics have become an increasingly prominent basis of student decisions, generalized university reputation, and the resources university’s attract. We review the history of metrics in higher education and scholarship about the influence of ranking on the position and strategic behavior of universities and students. Most quantitative analyses on this topic estimate the influence of change in university rank on performance. These studies consistently identify a small, short-lived influence of rank shift on selectivity (e.g., one rank position corresponds to ≤1% more student applicants), comparable to ranking effects documented in other domains. This understates the larger system-level impact of metrification on universities, students, and the professions that surround them. We explore one system-level transformation likely influenced by the rise of rankings. Recent years have witnessed the rise of enrollment management and independent educational consultation. We illustrate a plausible pathway from ranking to this transformation: In an effort to improve rankings, universities solicit more applications from students to reduce their acceptance rate. Lower acceptance rates lead to more uncertainty for students about acceptance, leading them to apply to more schools, which decreases the probability that accepted students will attend. This leads to greater uncertainty about enrollment for students and universities and generates demand for new services to manage it. Because these and other system-level transformations are not as cleanly measured as rank position and performance, they have not received the same treatment or modeling attention in higher education scholarship, despite their importance for understanding and influencing education policy.

Citation

Tutterow, C. and Evans, J.A. (2016), "Reconciling the Small Effect of Rankings on University Performance with the Transformational Cost of Conformity", The University Under Pressure (Research in the Sociology of Organizations, Vol. 46), Emerald Group Publishing Limited, Leeds, pp. 265-301. https://doi.org/10.1108/S0733-558X20160000046009