Search results

The authors contribute to practice-driven institutionalism by examining how the introduction of new field-level evaluation practices may facilitate encroachment of highly institutionalized organizational fields by new institutional logics. The authors conducted an inductive study of a trial of social impact bonds in the field of social integration services in Finland. Our analysis elaborates how new field-level evaluation practices created an experimental space that induced organizational practice experimentation, reconfigured relationships among field members, and lowered the barriers to entry for new organizations. The authors theorize how evaluation practices may create experimental spaces by suspending the carriers of established logics and legitimizing institutional innovations. The authors further elaborate how such spaces can bring about a parallel “shadow field” by inducing bottom-up experimentation aligned with a new institutional logic.

The purpose of this research is to study how compliance evaluation becomes performed in practice. Compliance evaluation is a common practice among organizations that need to evaluate their posture against a set of criteria (e.g. a standard, legislative framework and “best practices”). The results of these evaluations have significant importance for organizations, especially in the context of information security and continuity. The author argues that how these evaluations become performed is not merely a “social” activity but shaped by the materiality of the evaluation criteria

The authors adopt a sociomaterial practice-based view to study the compliance evaluation through in situ participant observations from compliance evaluation workshops to evaluate organizational compliance against a information security and business continuity criteria. The empirical material was analyzed to construct vignettes that serve to illustrate the practice of compliance evaluation.

The research analysis shows how the information security and business continuity criteria themselves partake in the compliance evaluations by operating through (ventriloqually) the evaluators on three strata: the material, the textual and the structural. The author also provides a conceptualization of a hybrid agency.

This research contributes to lack of studies on the organizational-level compliance. Further, the research is an original contribution to information security and business continuity management by focusing on the practices of compliance evaluation. Further, the research has theoretical novelty by adopting the ventriloqual agency as a hybrid agency to study the sociomateriality of a phenomenon.

This study focused on the impact of principals' leadership content knowledge, evaluation practices and teachers' professional learning activities on classroom instruction.

Data were collected from 425 teachers who worked in 46 elementary and lower secondary public schools within two provinces in Turkey. Teachers were asked to fill out a questionnaire on principals’ leadership content knowledge, evaluation feedback, professional learning activities and changed instructional practices. This study employed multilevel structural equation modeling (MSEM) by using the Bayesian estimation method to analyze the research hypotheses.

Findings indicate that if teachers perceive the evaluation progress as more useful, then they will participate in more professional learning activities, and they will be more effective in their classroom practices. This study also indicates that teachers' professional learning activities stimulate their instructional practices.

Although the number of schools and teachers allows using multilevel analysis, it limits the findings generalized beyond the sample. To compensate for this limitation, the author confirmed that the sample was representative of the larger population by examining the size of students and teachers, SES and teachers' job experience. The author also conducted a Bayesian estimator to strengthen the test of significance of effects.

This study underlines the critical role of leadership content knowledge in evaluating practices and providing useful feedback perceived by teachers in elementary and secondary schools. Principals should lead to instruction by knowing how to address a lack of teachers' pedagogical content knowledge and classroom practices. The Ministry of Education should support principals in becoming effective instructional leaders to observe teachers and provide them meaningful feedback on teaching.

Despite increased interest in this construct, research on principals' and teachers' responses to adapt the recent form of teachers’ performance evaluation systems is scant, especially in developing countries’ context. Moreover, little is known about the paths through which principals can enhance classroom practices by providing useful feedback. Given these trends in policy and practice context, this study provides empirical evidence that principals can enact the teachers' performance evaluation that affects classroom instruction.

Purpose – The author examines the implementation and characteristics of teacher evaluation and explores their associations with improvement in teachers’ practice of constructivist instruction.Methodology – This quantitative study uses statewide longitudinal Teachers’ Opportunity to Learn survey data collected in 2009 and 2010 from middle school mathematics teachers in Missouri and estimates a series of value-added models with two-level Hierarchical Linear Modeling.Findings – Teachers in this study were mainly evaluated by principals who conducted classroom observations and held face-to-face meetings to evaluate teaching practice and professional development activities. The study provides empirical evidence and support for the use of multiple evaluators with multiple evaluation data and outcomes in teacher evaluation. Additionally, it highlights the potential benefits of focusing on teachers’ instructional data instead of student achievement in teacher evaluation in order to improve their teaching practice.Research limitations – This study focused on middle school mathematics teachers in a single state in the United States. Whether these findings can be generalized to teachers of other subject areas or grades, or to states with different policy contexts, or to countries with country-specific structural, cultural, and social differences is unknown.Value – This study is the first effort to systematically examine teacher evaluation practices across a single state and provide empirical evidence on the relationships between the implementation characteristics of teacher evaluation and improvement in teachers’ instructional practice. Findings of this study provide school, district, state, federal, and international policymakers and administrators with important, up-to-date information on teacher evaluation at the middle-school level in the United States.

The paper discusses the influence of instructional leadership on effective teacher teaching practices and learning outcomes. In particular, the paper examines one of the instructional leadership practices, namely teaching evaluation, and seeks to investigate the influence on the effective teacher practices and on the achievement of 6th grade primary school students studying mathematics in the Cyprus educational system.

A quantitative research approach was deemed appropriate and employed for the purpose of the research subject, and in particular for the type of questions studied. Data were collected from 81 principals, 139 6th grade teachers and 1,553 students in the Cyprus educational system. In addition, data analysis was performed using structural equation models (SEM).

The instructional leadership approach assumes that principal evaluations influence high learning outcomes. Findings demonstrated that the principal evaluation has a positive and statistically significant impact on effective teaching practices and student achievement.

It is important to acknowledge that in the Cyprus educational leadership field the corellation among the instructional leadership, the effective teaching practices of teachers and the students achievements were not examined through the above parameters. Furthermore, the survey provided important insights into the principals, teachers, pupils and, more generally, on Cyprus's educational policy.

The idea of “best practice” is very much built into information systems and the ways in which they organise and structure work. The purpose of this paper is to examine how “best practice” may be identified (produced) through a community-based evaluation process as opposed to traditional expert-based evaluation frameworks. The paper poses the following research questions: how does “best practice” (e)valuation in online communities differ depending on whether they are produced by community members or experts? And what role play these two practices of valuation for online community performance?

The paper is based on a three-year ethnographic study of a large-scale online community initiative run by the European Commission. Participant observation of online and offline activities (23 events) was complemented with 73 semi-structured interviews with 58 interviewees. The paper draws on Science and Technology Studies, and in particular actor-network theory.

Promoting the idea of “best practice” is not just an exercise about determining what “best” is but rather supposes that best is something that can travel across sites and be replicated. The paper argues that it is crucial to understand the work performed to coordinate multiple practices of producing “best practice” as apparatuses of valuation. Hence if practices are shared or circulate within an online community, this is possible because of material-discursive practices of dissociation and association, through agential cuts. These cuts demarcate what is important – and foregrounded – and what is backgrounded. In so doing new “practice objects” are produced.

The research was conducted in the European public sector where participants are not associated through shared organisational membership (e.g. as employees of the same organisation). An environment for determining “best practice” that is limited to an organisation’s employees and more homogeneous may reveal further dynamics for “best practice” production.

This paper sheds light on why it is so difficult to reach commensuration in crowd-sourced environments.

The paper provides an analysis of how online community members collaborate in order to identify relevant and meaningful user-generated content. It argues that “best practice” is produced through a process of commensuration.

This chapter will focus on the use of evaluative research in higher education policy analysis. The approach will be illustrated by reference to higher education policy in Scottish higher education, with particular reference to the longitudinal evaluative research of support of teaching and learning (T&L) (the Quality Enhancement Framework or QEF). The chapter will discuss the features of the research process which are shaped by evaluation theory. We adopt a theoretical position on policy research which foregrounds the situated experience of policy as a core research focus. Policy is depicted as being underscored by an implicit theory of change which is used to structure and orientate the research focus. The design of the research is characterised by the involvement of potential users of the research output, with implications on the way in which findings are articulated, presented and ultimately used, along with aspects of the evaluative research design. The case study of the QEF will be contextualised, and the intersection between the design features and theoretical approaches, and the use and usability of research outputs, will be established.

In recent years, expectations for demonstrating the impact of public diplomacy programs have dramatically increased. Despite increased calls for enhanced monitoring and evaluation, what texts exist on the subject suggest the state of practice is grim. However, while the current debate is based mostly on practice reports, conceptual work from academics or anecdotal evidence, we are missing empirical insights on current views of monitoring and evaluation from practitioners. Such a practice-level perspective is central for better understanding factors that may actually drive or hamper performance evaluation in day-to-day public diplomacy work. The purpose of this paper is to update knowledge on the state of evaluation practice within public diplomacy from the perspectives of practitioners themselves.

This study assesses the state of evaluation in public diplomacy through qualitative interviews with public diplomacy officers working for the US Department of State – a method heretofore unused in studies of the topic. In total, 25 in-depth interviews were conducted with officers in Washington, DC and at posts around the world.

The interviews suggest that practitioners see evaluation as underfunded despite increased demands for accountability. Further, the results show a previously not discussed tension between diplomacy practitioners in Washington, DC and those in the field. Practitioners are also unclear about the goals of public diplomacy, which has implications for the enactment of targeted evaluations.

The research uncovers the perceptions of evaluation from the voices of those who must practice it, and elaborates on the common obstacles in the enactment of public diplomacy, the influence of multiple actors and stakeholders on evaluation practice, as well as the perceived goals of public diplomacy programming. No empirical research has considered the state of evaluation practice. Moreover, the study uses qualitative interview data from public diplomacy officers themselves, an under-used method in public diplomacy research. The findings provide insights that contribute to future public diplomacy strategy and performance management.

The purpose of this paper is to look across six first-year principals to investigate their engagement with and sensemaking of specific messages of instructional leadership around teacher evaluation.

This research project, a cross-case study, was carried out using in-depth qualitative observations and interviews of six first-year principals over one school year. Sensemaking theory was used to analyze both how and the mechanisms through which principals understood their roles as teacher evaluators.

The results demonstrate that first, principals received a variety of messages about how to conduct teacher evaluations, and second, that connections to specific individuals influenced their associations to specific messages they received about instructional leadership and how they enacted teacher evaluation practices on their campuses.

This is an in-depth qualitative analysis, and therefore is not generalizable to all first-year principals, school districts, or principal preparation programs. However, it adds to the field’s understanding of the meso level of policy implementation, highlighting the process of individuals’ sensemaking and the importance of their informal connections in the associations they make to messages about instructional leadership.

This research adds to the field of principal preparation and induction as it highlights what is important for first-year principals as they build their professional identities. Further, it highlights the variability in principals’ understanding and enactment of teacher evaluation policies, an important feature as this practice is coming to the fore both in current practice and research.

This study adds to an understanding of institutional theory by looking at the interaction between the organizational levels, and further explicates individual actors’ agency within a socio-organizational context. The findings also add to a dearth of empirical studies on the routine of teacher evaluation from the principal perspective.

This article aims to assess the awareness among educators of strategies put in place for peer teacher evaluation (PTE), and training opportunities availed to them in relation to PTE.

The study was conducted in secondary schools in three selected districts of Western Province of Kenya using a descriptive survey design. Data were collected from school principals, senior teachers, heads of departments and teachers using questionnaires, interview schedules and a document analysis guide.

The findings generally revealed that though all schools where PTE was practised had made some attempts to organise some awareness programmes, they were not focused as evidenced in the varied reasons that were provided to show why they were organised. The study also established that less than half of the teachers had been exposed to in-service training opportunities.

There is scarce literature based on empirical studies focusing on school-based teacher evaluation (SBTE). Most of the studies the author was able to access were descriptive and on teacher evaluation in general. Consequently, most recent studies in Kenya, for example, tend to focus on topical issues like HIV/AIDS, gender, Free primary education and how they impact on curriculum implementation while what goes on in the classrooms is ignored.

Identifying and analysing awareness strategies and in-service teacher training related factors that hinder and/or promote PTE may help in strengthening the practice if the recommendations of this study are implemented. Findings of this study if accessed may provide information to policy makers both at national, local and school levels in Kenya on the practice of PTE. National and local policy gives legality to PTE while school policy directs the process and procedures for the practice at school level. This study also provides a theoretical knowledge that precedes the practice of PTE.

Peer Teacher Evaluation embraces characteristics such as collaboration, collegiality and dialogue and so can enhance positive working relationships among teachers. Teachers in the classroom are known to maintain cultural norms of privacy and individualism. Peer Teacher Evaluation being teachers evaluating each other, therefore, removes the culture of privacy and individualism. If well practised, it may promote rapport and trust among teachers.

The study analysed the level of awareness and in-service training of teachers on PTE which is one of the modes of SBTE in secondary schools with the purpose of coming up with suggestions that may help bring about improvement in the practice in order to strengthen it in schools.