Search results

This chapter focuses on a new school-level instrument for international benchmarking and policy learning – the OECD’s PISA-based Test for Schools (“PISA for Schools”) – and how it helps to constitute new global spaces and relations of education policymaking and governance. Unlike main PISA, PISA for Schools assesses school performance in reading, mathematics, and science against the schooling systems measured by the main PISA test. Schools are thus positioned within a globally commensurate space of measurement and comparison, and are encouraged to engage with, and learn from, the policy expertise proffered by “high-performing” international schooling systems and the OECD itself. Drawing suggestively across literature and theorizing around new spatialities associated with globalization, the “becoming topological” of culture and “power-topologies,” and informed by document analysis and interviews with 33 policy actors from across the PISA for Schools policy cycle, the chapter examines how PISA for Schools helps the OECD to directly “reach into” local schooling spaces. This respatialized PISA for Schools, or “PISA to Schools”, provides the OECD with the means to influence how schooling is practised and conceived at the level of local policy implementation, while limiting mediation by national and/or subnational politics. Moreover, the school-to-system performance comparisons enabled by PISA for Schools arguably provide one of the first – if not the only – international data-driven catalysts of school-level reform. This furthers the relevance and diffusion of “lessons” from main PISA and the OECD to schools themselves, and helps extend the epistemic communities through which the OECD practices its global epistemological governance of education.

This study investigates national trends in students’ science, technology, engineering, and mathematics (STEM) occupational expectations by using Program for International Student Assessment (PISA) 2000, 2003, and 2006 data. The analyses in this study revealed several noteworthy national trends in STEM occupational expectations. In many countries students’ computing or engineering (CE) occupational expectations changed between PISA 2000 and PISA 2006, while students’ health service (HS) occupational expectations remained constant. In particular, many developed countries experienced downward national trends in CE occupational expectations among top performers in science. This study also found gender differences in national trends in STEM occupational expectations. In many countries boys’ CE occupational expectations decreased between PISA 2000 and PISA 2006, while girls’ occupational expectations remained unchanged in both CE and HS fields. Finally, the gender gaps in CE occupational expectations converged in many countries, but this convergence was not due to increases in CE occupational expectations among girls, but rather decreases in expectations among boys. Because one of the policy goals in many countries is to promote engagement in STEM education and occupations among students, especially academically talented students, the current findings – national declines in CE occupational expectations among top academic performers – will most likely be viewed as problematic in several countries. Future research should use data collected over longer periods to investigate whether students’ interest in STEM education and occupations increased or decreased in a variety of countries, and whether these patterns varied by student characteristics and performance levels. Moreover, future research must focus on factors that can explain the national trends in student interest in STEM education and occupations.

This research paper tries to look into the issues of achievement gaps in education in Gulf countries. The paper sets forth an idea that the international projects such as Programme for International Student Assessment (PISA), Trends in International Mathematics and Science (TIMSS), and Progress in Reading Literacy Study (PIRLS) could serve not only as means of setting and checking quality standards in education but also as mediators in closing achievement gaps and in helping increase the accountability of schools toward the wider public. The paper also makes an attempt to look at the relative standing of Arab Gulf countries in the international projects such as TIMSS, PISA, and PIRLS. The research assumes that the large-scale international data might appear useful for benchmarking the progress made in any individual country. The paper suggests that the arrows of influence move and operate in both directions, implying that while setting global standards, international projects base their judgments on identified local challenges in education systems of individual countries. Most importantly, they could be used in influencing national policies to make education systems more transparent and comparable to international standards.

First, the paper states that in order to carry out the benchmarking process efficiently and obtain meaningful results for policy making on an international level, assessment procedures such as testing and questionnaire reporting should be conducted on a local level prior to moving to international level. The paper draws experiences from high-performing countries such as Chinese Taipei, South Korea, and Japan. These countries go through intensive local testing practices at early schooling stages before moving on to participating in TIMSS, PISA, and PIRLS projects. Consequently, school children, schools, school districts, and entire countries show high academic readiness and performance at the fourth and eighth grades on an international level.

Second, the paper hypothesizes that discrepancies between teaching methodologies of items covered by individual country curricula, a variety of approaches toward explanation and delivery of various concepts to students, and teacher-specific implementation of theory and practice balance during classes could all potentially contribute to wide gaps and discrepancies between TIMSS, PISA, and PIRLS scores of separate countries no matter how similar their national curricula might look. Strategies for narrowing down examination and questionnaire issues to the items covered in the curricula of all countries have been offered on several occasions; however, this procedure causes oversimplification of teaching and items, and leads to considerable lowering of standards. Therefore, this issue has been presenting a substantial dilemma in TIMSS, PISA, and PIRLS projects’ success across countries.

Since the publication of its first results in 2000, the Programme for International Student Assessment (PISA) implemented by the OECD has repeatedly been the subject of heated debate. In late 2014 controversy flared up anew, with the most severe critics going so far as to call for a halt to the programme. The purpose of this paper is to discuss the methodological design of PISA and the ideological basis of scientific and policy arguments invoked for and against it.

The authors examine the soundness of the survey methodology and identify the conflicting interpretations and values fuelling the debate.

The authors find that while PISA has promoted the focus on the important subject of children's education worldwide there are legitimate concerns about what PISA measures, and how. The authors conclude that the OECD should be more transparent in the documentation of the methodological choices that underlie the creation of the data and more explicit about the impact of these choices on the results. More broadly, the authors advise caution in the attempt to derive and apply evidence-based policy in the domain of education; the authors furthermore propose an alternative model of social inquiry that is sensitive and robust to the concerns of the various actors and stakeholders that may be involved in a given policy domain.

The issues and tensions surrounding the PISA survey can be better understood in the framework of post-normal science (PNS), the application of which to the PISA controversy offers a potential solution to a stalemate.

The purpose of this paper is to combine seemingly unrelated factors to explain global competitiveness. The study argues that school discipline and education investment affect competitiveness with the association being mediated by educational performance. Crucially, diachronic effects of discipline on performance are tested to demonstrate effects over time.

Partial least square (PLS) modelling is used to analyse the Organization for Economic Co-operation and Development’s Programme for International Student Assessment (PISA) data. The study further draws from World Bank data on Government Expenditure and World Economic Forum data on competitiveness. Five PISA dimensions of school discipline (students listening well, noise levels, teacher waiting time, students working well, class start time) are hypothesised to affect academic performance in reading, math and science, and to ultimately impact competitiveness.

Findings confirm the relative importance of school discipline (88 per cent) in comparison to education investment (12 per cent) on educational performance, with both variables also being found to be significantly associated with competitiveness directly.

This study demonstrates the time effects of discipline, more specifically that discipline dimensions (students listen well in 2003 and students work well in 2009) are associated with competitiveness in 2012. Implications for school policy and further research are discussed.

Increased interest in team dynamics has resulted in new methods for measuring teamwork over time. The primary purpose of this chapter is to provide a survey of recent developments in teamwork/collaboration measurement in an educational context. Key topics include conceptual frameworks, large-scale assessments, and innovative measurement techniques.

A range of methods for collecting and analyzing teamwork data are discussed, and five frameworks for measuring collaborative problem solving (CPS) over time are compared. Frameworks from Programme for International Student Assessment (PISA), Assessment and Teaching of 21st Century Skills (ATC21S) project, Educational Testing Service (ETS), ACT, and von Davier and Halpin (2013) are discussed. Results of assessments developed from these frameworks are also considered.

New techniques for measuring team dynamics over time have great potential to improve education and work outcomes. Preliminary results of the assessments developed from these frameworks show that important advances in teamwork measurement have been enabled by innovative task designs, data-mining techniques, and novel applications of stochastic models.

This novel overview and comparison of interdisciplinary approaches will help to indicate where progress has been made and what challenges are ahead.

The aim of this article is to explain commonalities and differences in the responses of four national educational science communities to the same external stimulus, namely international comparative large scale student assessments that offered vastly improved comparability of national results from the beginning of the 1990s. The comparison shows the epistemic traditions of educational research in the four countries and properties of the data produced by the international comparative studies to be the central explanatory factors for commonalities and differences of responses to the new studies.

This paper aims to analyse contrasting discourses on education and competitiveness from four countries to show the different national values that are a key driver in economic development.

The paper uses content analysis to compare and contrast the newspaper discourse surrounding the OECD Program for International Student Assessment (PISA) in four countries with above OECD average performance: Japan and South Korea (improving performance) and Australia and Finland (declining performance). PISA has attracted much government and public attention because it reflects education and the economic value of that education.

There are key contrasts in the discourses of the four countries. Despite shifts to globalised perspectives on education, strong national and cultural differences remain. Educational competitiveness and economic competitiveness are strong discourses in Japan and South Korea, while in Australia and Finland, the focus is on educational competitiveness. The media in Finland has few references to economic competitiveness and it does not feature in Australia. The discourse themes on PISA from 2001 to 2015 are presented with trends in educational attainment and shifting national perspectives on education.

Analysis is limited to the top two circulation newspapers in English language in each country over 2001 to 2015. These newspapers in Finland, Japan and South Korea include translated content from local language papers.

The paper provides longitudinal perspectives to understand the contrasting societal values placed on education and how these relate to perspectives on competitiveness. This media evidence on national discourses can inform education policy orientations in the four countries examined.

Evidence from past surveys suggests that some interviewees simplify their responses even in very well-organized and highly respected surveys. This paper aims to demonstrate that some interviewers, too, simplify their task by at least partly fabricating their data, and that, in some survey research institutes, employees simplify their task by fabricating entire interviews via copy and paste.

Using data from the principal questionnaires in the Programme for International Student Assessment (PISA) 2012 and the Programme for the International Assessment of Adult Competencies (PIAAC) data, the author applies statistical methods to search for fraudulent methods used by interviewers and employees at survey research organizations.

The author provides empirical evidence for potential fraud performed by interviewers and employees of survey research organizations in several countries that participated in PISA 2012 and PIAAC.

The proposed methods can be used as early as the initial phase of fieldwork to flag potentially problematic interviewer behavior such as copying responses.

The proposed methodology may help to improve data quality in survey research by detecting fabricated data.

The key questions explored in this volume converge around issues of educational governance in the context of globalization. The individual chapters each contribute to the goals of assessing the development of the educational agenda of the Organization for Economic Cooperation and Development (OECD) and providing evidence on the trajectories through which the organization’s programs and policies have directly and indirectly influenced and affected diverse educational systems. The chapter explores these issues in more depth, drawing on the perspectives presented in the volume’s individual chapters. The first section provides a discussion of the contexts that have given rise to the OECD as a key global education policy actor. Following this brief historical overview, some of the key findings raised by the volume’s authors are examined in the context of wider literature on global education policy. Collectively, the chapters raise important questions about the role of nation-states in educational planning, the scope and spatiality of international assessments such as PISA and TALIS, and the complexity of evidence and expertise in global, national, and local educational policy-making. The chapter concludes with a brief discussion of the implications of the volume’s work for the wider field of comparative and international education.