Search results
1 – 10 of over 130000Lijuan Li, Kerry John Kennedy and Magdalena Mo Ching Mok
The purpose of this paper is to establish and compare multilevel models that significantly predict school effects on adding value to their students regarding English reading from…
Abstract
Purpose
The purpose of this paper is to establish and compare multilevel models that significantly predict school effects on adding value to their students regarding English reading from Secondary One to Secondary Six.
Design/methodology/approach
The data were collected from 3,993 students within 66 schools in 2006 by the Educational Bureau of Hong Kong.
Findings
When entering Secondary One, the students’ English reading ability was tested then again at Secondary Six. A range of value-added models were fitted to the data. The comparison across these models suggests that student individual scores at intake are the most powerful indicators of value-added. The intake aptitude test scores, aggregated to school level, and gender made no significant difference. At the individual level, student band was the significant predictor. School level effects were largely non-significant. Specific findings on value-added across the schools are visualized as evidence of the parsimony of the selected model.
Research limitations/implications
Secondary data such as this while collected at one point in time nevertheless can still shed light on current policies and practices. It is particularly the case considering that the value-added effects system is still working in Hong Kong over decades but less examined academically.
Originality/value
This study has produced some insights for stakeholders to identify influences on the value-added patterns.
Details
Keywords
The purpose of this paper is to determine whether teachers with high value‐added scores (as a measure of teacher quality) stay or left test grades and subjects in a medium‐sized…
Abstract
Purpose
The purpose of this paper is to determine whether teachers with high value‐added scores (as a measure of teacher quality) stay or left test grades and subjects in a medium‐sized school district.
Design/methodology/approach
Panel data for this paper encompass teachers providing math and reading instruction and link to individual students in grades 3‐10 from a single Florida school district (2000‐2001 to 2004‐2005). Value‐added modeling is used to estimate a measure of teacher quality, which is entered into binomial logistic regression models.
Findings
This paper finds a negative relationship between reading teachers' value‐added scores and attrition (p<0.05) – a finding consistent with the few that have examined the relationship between value added and teacher attrition. A significant relationship is not found between math value added and attrition. There is also no significant relationship between value added and transferring. Secondary and alternatively certified teachers are more likely to exit tested grades/subjects. Classroom percentages of students enrolled in the free/reduced lunch program (a proxy for poverty) are associated with leaving among math and reading teachers.
Practical implications
Not all turnover is negative. Evidence from this paper suggests that schools are not losing the best teachers from tested subjects and grades – those in which schools and school leaders are held accountable. While there are costs associated with turnover, it can serve as an important matching function between workers and employers.
Originality/value
Only, a few published studies have utilized value‐added scores as the measure of teacher quality and tested their relationship with teacher attrition.
Details
Keywords
The United Kingdom (UK) has recently published secondary education value added measures. This paper examines whether the approach used could also offer a possible method for…
Abstract
Purpose
The United Kingdom (UK) has recently published secondary education value added measures. This paper examines whether the approach used could also offer a possible method for measuring value added in higher education (HE).
Design/methodology/approach
Previous attempts to measure HE value added in the UK, such as comparative value added (CVA), met with criticism relating to their estimation of the “expected” degree class (DegCL). This paper examines whether the recent experiences in secondary education give any insights into solving this problem.
Findings
The paper identifies that the techniques applied in secondary education are remarkably similar to those used by CVA, and it argues that they appear to suffer from similar pitfalls. It is shown, through a statistical analysis, that in practice a whole range of factors have a significant influence on degree performance.
Research limitations/implications
The data set used in the statistical analysis of HE performance is relatively old. Future research could repeat this study with recent data.
Practical implications
The development of an accurate measure of value added in HE will need to apply measuring techniques that are significantly more sophisticated than those used for UK secondary education.
Originality/value
The value of this paper is that it identifies key issues that will need to be addressed before a credible measure of value added can be developed for HE.
Details
Keywords
Linda Bendikson, John Hattie and Viviane Robinson
One of the features of the New Zealand secondary schools system is that achievement closely reflects the taught curriculum. The National Certificate of Educational Achievement…
Abstract
Purpose
One of the features of the New Zealand secondary schools system is that achievement closely reflects the taught curriculum. The National Certificate of Educational Achievement (NCEA) directly assesses student achievement on the secondary school curriculum through a combination of criterion‐based internal and external assessments. The nature of NCEA means school‐level results not only reflect student achievement but also the ability of leaders to organise, deliver, and monitor a relevant curriculum for students. This paper aims to describe how NCEA data were used to develop a simple but fair system to assess the relative performance of secondary schools.
Design/methodology/approach
No standardised measures of performance prior to Year 11 are available in New Zealand. Nor are student‐level data available. In the absence of these, multiple indicators of gross performance, added value and improvement over time were analysed using a schools‐of‐similar‐type methodology.
Findings
Results indicated that schools in the low and middle SES communities were more likely to be improving than others, but these improving schools were also more likely to be already high‐ or mid‐performing. Low‐performing schools were least likely to be improving.
Originality/value
Some advantages of this methodology are its ability to be utilised with any publicly available standards‐based achievement data, its validity as an indicator of leadership and organisational performance, and its ability to track school performance trends over time.
Details
Keywords
Hella Bel Hadj Amor, Amy Ellen Schwartz and Leanna Stiefel
We examine variation in high school and college outcomes across New York City public high schools. Using data on 80,000 students who entered high school in 1998 and following them…
Abstract
We examine variation in high school and college outcomes across New York City public high schools. Using data on 80,000 students who entered high school in 1998 and following them into the City University of New York, we investigate whether schools that produce successful high school students also produce successful college students. We also explore differences in performance across sex, race, and immigration, and we briefly explore selection issues. Specifically, we estimate student-level regressions with school fixed effects, controlling for student characteristics, to identify better and worse performing schools based on state mandated exams, graduation, and college performance.
Pamela Sammons, Susila Davis, Christopher Day and Qing Gu
The purpose of this paper is to discuss the use of mixed methods research in a major three year project and focuses on the contribution of quantitative and qualitative approaches…
Abstract
Purpose
The purpose of this paper is to discuss the use of mixed methods research in a major three year project and focuses on the contribution of quantitative and qualitative approaches to study school improvement. It discusses the procedures and multiple data sources used in studying improvement using the example of a recent study of the role of leadership in promoting improvement in primary and secondary schools’ academic results in England. Although the definition of improvement used was based on robust analyses of data on students’ academic outcomes, the mixed methods design enabled a broader perspective to be achieved.
Design/methodology/approach
The study illustrates how the multilevel analysis of students’ national assessment and examination results based on national data sets for primary and secondary schools in England were used to investigate the concept of academic effectiveness based on value-added methodology. Using three successive years of national results a purposive sample of schools were identified that could be classified as both effective and improving over the period 2003-2005. In addition, surveys and interviews were used to gather evidence of the role of stakeholder perceptions in investigating school improvement strategies and processes.
Findings
National student attainment data sets were used for the identification of improving and effective schools and revealed the importance of considering their different starting points in their classification of three distinctive improvement groups. The combination of quantitative survey data from headteachers and key staff with qualitative case study data enabled a range of analysis strategies and the development of statistical models and deeper understanding of the role of leadership.
Research limitations/implications
The limitations of a focus on only academic outcomes and “value-added” measures of student progress are discussed. The challenges and opportunities faced in analysis and integration of the different sources of evidence are briefly explored.
Practical implications
The study contributes to the knowledge base on the identification of school improvement and use of performance data. The findings on strategies and processes that support improvement are of relevance to policy makers and practitioners, especially school leaders.
Originality/value
The mixed methods design adopted in the study enabled the research to combine rigorous quantitative and in-depth qualitative data in new ways to extend and make new claims to knowledge about the role of school leadership in promoting school improvement based on the study of effective and improved schools’ experiences.
Details
Keywords
Hsiao-Pei (Sophie) Yang and Julie Robson
Purpose – The purpose of this chapter is to develop a conceptual framework that provides insight and aids understanding of the complex array of relationships schools have with…
Abstract
Purpose – The purpose of this chapter is to develop a conceptual framework that provides insight and aids understanding of the complex array of relationships schools have with individuals, organizations, and other entities.
Design/methodology/approach – The conceptual framework is drawn from the relationship marketing (RM) literature and applied to a school context in the United Kingdom. In doing so, it provides a simplified representation of the environment in which schools operate and a valuable classification structure for the many different relationships a school has. This framework will be of benefit to both academics and practitioners.
Findings – The authors find that the relationships schools have can be classified within the conceptual framework. The framework aids understanding of the different relationships and provides insights into how these relationships can be developed and where value can be added. Application of the framework also highlights the complex nature of the relationships schools can have with others and the need to manage those relationships well.
Research implications – The framework developed in this chapter is conceptual and needs to be tested empirically.
Originality/value – This chapter responds to the call from Oplatka and Hemsley-Brown (2004) to provide further research into the area of RM in the context of schools. It adds value by drawing together various aspects of RM, providing an analysis of their relevance to educational services marketing and identifying and applying a conceptual framework which classifies the relationships schools have with others. This chapter provides important insights for those within schools who are responsible for the management of relationships with their organization and for others seeking to foster greater engagement with schools.
The purpose of this paper is to investigate the willingness of households to pay for academic and deprivation-compensating components of the Contextual Value Added (CVA) indicator…
Abstract
Purpose
The purpose of this paper is to investigate the willingness of households to pay for academic and deprivation-compensating components of the Contextual Value Added (CVA) indicator of school quality used in England in order to locate themselves in the catchment area of state schools. Deprivation-compensating school performance, defined as the difference in the disadvantaged intake between two schools with the same academic performance.
Design/methodology/approach
The empirical analysis, based on data drawn from three independent UK data sources, used parametric and non-parametric analysis approaches. The analysis conducted separately for primary and secondary schools, because household behaviour can differ between these two levels of education.
Findings
Consumers are willing to pay for houses in the catchment area of primary and secondary schools with high academic achievement, as measured by the mean score; whereas, the component of the CVA indicating deprivation-compensating aspects of school performance is found to have a positive effect only on the price of houses in the catchment area of primary schools in London; its impact on the price of houses elsewhere is mostly negative.
Practical implications
The analysis in this study suggested that the recently adopted practice of using CVA as a measure of school quality in England can encourage government and Local Authorities to pay more attention to raising the deprivation-compensating aspects of school performance of their schools.
Originality/value
This is the first study to explore the value which households attach to deprivation-compensating outcomes, at a given level of academic performance using the CVA indicator.
Details
Keywords
Aubrey H. Wang, Alyssa M. Walters and Y.M. Thum
The purpose of this paper is to provide an empirical comparison of two measures of school success – a value‐added assessment system and the federally‐mandated system of adequate…
Abstract
Purpose
The purpose of this paper is to provide an empirical comparison of two measures of school success – a value‐added assessment system and the federally‐mandated system of adequate yearly progress (AYP) – to identify highly effective urban schools in the USA and to explore the predictive relationship between evidence‐based decision‐making and school improvement.
Design/methodology/approach
A total of 204 urban schools with 6,684 teachers and 149,665 students in grades 1 through 10 participated in the study. Data included teacher survey and students’ standardized reading and math scores from 2002 through 2005. Analyses included factor analysis, growth modeling, and multiple logistic regression analyses.
Findings
AYP status was strongly predicted by student and school demographics rather than by organizational climate and instructional practices. In contrast, school growth as measured by the district's value‐added assessment system was unrelated to the demographics of the student population and related strongly to specific school practices. Specifically, high growth schools exhibited strong evidence‐based decision‐making practice where teachers used the district's benchmark assessment to reflect on instructional practice, used the core curriculum to guide instruction, and received frequent and high quality professional development on reading and math instruction.
Practical implications
As states gravitate away from relying on AYP status as a measure of school success, districts will benefit from integrating measures of growth and using school data management systems that integrate benchmark assessment capabilities and provide teachers with the training and tools needed to use the information in their daily practice.
Originality/value
This study provides a direct comparison of evaluation models using a variety of current methods within a single district that has played a central and highly‐visible role in the education reform movement in the USA.
Details
Keywords
Maria Conceição A. Silva Portela, Ana Santos Camanho and Diogo Nóvoa Borges
The purpose of this paper is to illustrate the implementation of a web‐based platform integrating benchmarking and data envelopment analysis (DEA) for the Portuguese secondary…
Abstract
Purpose
The purpose of this paper is to illustrate the implementation of a web‐based platform integrating benchmarking and data envelopment analysis (DEA) for the Portuguese secondary schools.
Design/methodology/approach
The benchmarking platform is designed around a set of key performance indicators that are displayed using benchmarking graphs. These indicators are also aggregated through the methodology of DEA to provide a summary measure of performance.
Findings
The benchmarking platform developed enables schools to perform internal and external evaluation through a standard model that is based on indicators of school activities. It encourages schools' efforts of continuous improvement and increases society awareness regarding schools' context and results obtained.
Practical implications
The benchmarking platform can be useful for schools and general public. For the general public, there is a tool that allows the construction of user‐defined rankings online and benchmarking tools that allow the comparison of performance of a specific school with others. In addition to these features, schools have in the BESP platform a repository of historical data, and the possibility to see a set of graphs that show for some indicators their evolution over time.
Originality/value
This paper describes a breakthrough in the Portuguese education context. The BESP platform is the first in this context to combine DEA and benchmarking tools in a web‐based environment, designed to enable real‐time performance assessments.
Details