Search results

The purpose of this paper is to report a field-based quasi-experimental study designed to examine the effectiveness of a transformational leadership intervention in remediating poor performance. The intervention was conducted on elements of the organization that senior management perceived as being low performing.

A quasi-experimental pre-test post-design was employed to evaluate the effectiveness of the transformational leadership intervention. Pre-test data were collected four months prior to the intervention starting and the post-test data were collected eight months after the intervention had started. Follower perceptions of their leader's behavior and group cohesion, together with training outcome data were used to evaluate the effectiveness of the intervention.

Results revealed that from pre-test to post-test changes in perceptions of leadership, group cohesion, and training outcome indicated that the intervention had beneficial effects. These beneficial effects were evidenced in one of two ways: desirable behaviors increased in the experimental group from pre-test to post-test while they remained the same or were decreased in the control group; or desirable behaviors remained the same in the experimental group while they decreased in the control group.

The current study is the first to utilize a quasi-experimental organization wide design to examine the efficacy of a transformational leadership intervention. Furthermore, the current study provides evidence that transformational leadership can buffer negative environmental effects.

This chapter analyzes a geographic quasi-experiment embedded in a cluster-randomized experiment in Honduras. In the experiment, average treatment effects of conditional cash transfers on school enrollment and child labor were large – especially in the poorest experimental blocks – and could be generalized to a policy-relevant population given the original sample selection criteria. In contrast, the geographic quasi-experiment yielded point estimates that, for two of three dependent variables, were attenuated. A judicious policy analyst without access to the experimental results might have provided misleading advice based on the magnitude of point estimates. We assessed two main explanations for the difference in point estimates, related to external and internal validity.

Education researchers have been urged to utilize causal inference methods to estimate the policy effect more rigorously. While randomized controlled trials (RCTs) are the gold standard for assessing causality, RCTs are infeasible in some educational settings, particularly when ethical concerns or high cost are involved. Quasi-experimental research designs are the best alternative approach to study educational topics not amenable to RCTs, as they mimic experimental conditions and use statistical techniques to reduce bias from variables omitted in the empirical models. In this chapter, we introduce and discuss the core concepts, applicability, and limitations of three quasi-experimental methods in higher education research (i.e., difference-in-differences, instrumental variables, and regression discontinuity). By introducing each of these techniques, we aim to expand the higher education researcher's toolbox and encourage the use of these quasi-experimental methods to evaluate educational interventions.

This paper covers different types of research designs, like, longitudinal, cross-section and sequential design, experimental design (including factorial experimental design), and correlational design, with illustrative examples. This paper will help a scholar to know how choice of research design depends on a number of parameters, highlighted by author.

Regression discontinuity (RD) design is a sophisticated quasi-experimental approach used for inferring causal relationships and estimating treatment effects. This paper aims to educate human resource development (HRD) researchers and practitioners on the implementation of RD design as an ethical alternative for making causal claims about training interventions.

To demonstrate the key features of RD designs, a simulated data set was generated from actual pre-test and post-test diversity training scores of 276 participants from three organizations in the USA. Parametric and non-parametric analyses were conducted, and graphical presentations were produced.

This study found that RD design can be used for evaluating training interventions. The results of the simulated data set yielded statistically significant results for the treatment effects, showing a positive causal effect of the training intervention. The analyses found support for the use of RD models with retrospective training intervention data, eliminating ethical concerns from random group assignment. The results of the non-parametric model provided evidence of the plausibility of finding the right balance between precision of estimates and generalizable results, making it an alternative to experimental designs.

This study contributes to the HRD field by explicating the implementation of a sophisticated, statistical tool to strengthen causal claims, contributing to an evidence-based HRD approach to practice and providing the R syntax for replicating the analyses contained herein.

Despite the growing number of scholarly articles being published in HRD journals, very few have used experimental or quasi-experimental design approaches. Therefore, a very limited amount of research has been devoted to uncovering causal relationships.

This paper aims to examine the prevalence and trend of experimental research in hospitality and tourism. Hospitality and tourism researchers have long been encouraged to increase their use of experimental designs. However, a solid support for such advocacy is lacking, and the present paper fills in this research gap.

By using a systematic approach, this study reviews 161 tourism and hospitality articles and conducts content analysis based on certain criteria including journal outlets, Social Sciences Citation Index journals, years of publication, contexts, disciplinary foci, experimental designs, settings, number of independent variables, number of studies per article, manipulation methods, manipulation check, research subjects, sample size, subjects per experimental condition, statistical analyses and provision of effect size. The criteria between hospitality and tourism publications are also compared.

Findings show that the number of experimental publications has significantly increased over the past decade, especially in hospitality publications. Nonetheless, there is still room for improvement in applying the experimental design in hospitality and tourism research.

Researchers in hospitality and tourism are recommended to report manipulation check results and the effect size of statistically significant results, as well as to devote more effort to knowledge accumulation and methodological advancement of experimental designs.

This study is the first to review experimental research in hospitality and tourism. The findings of this study provide significant implications and directions for hospitality and tourism researchers to conduct experimental research in the future.

Existing experimental and quasi-experimental results have demonstrated that both anticorruption initiatives that provide information and/or authority to the recipients of government programs – so-called “bottom-up” interventions – and initiatives that rely on government agencies for enforcement – “top-down” interventions – can be effective in some settings. Yet, in other instances, both forms of intervention have been found to be ineffective in combating corruption. These contrasting results strongly suggest that the effectiveness of both “top-down” and “bottom-up” anticorruption interventions is conditional on other factors. Unfortunately, the existing literature says little regarding the conditions conducive to the success of either forms of intervention. Assessing the conditional effects of anticorruption treatments poses substantial challenges for researchers – particularly for those employing experimental or quasi-experimental approaches. This chapter (1) discusses factors that may condition the effectiveness of both top-down and bottom-up interventions; (2) illustrates the difficulties in assessing these conditional relationships, with particular reference to experimental and quasi-experimental settings; and (3) suggests approaches that might mitigate these problems.

Tests of assumed mediation models are common in research in many disciplines, including managerial psychology, industrial and organizational psychology, organizational behavior, and organizational theory. Thus, the purpose of this paper is to detail experimental design options for conducting such tests in a manner that has the potential to yield results that have high levels of internal and construct validity.

The paper presents a logical analysis of strategies for testing mediation models so as to insure valid inferences about causal relations between variables.

The most appropriate strategy for testing assumed mediation models is research that uses randomized experimental designs.

Managers should base their actions on valid evidence about phenomena. More specifically, managerial actions should be predicated on research results that have high levels of internal, construct, and statistical conclusion validity. Thus, this paper encourages managers to base decisions about organizational policies and practices on well‐designed experimental research.

This paper addresses a number of points about issues involving internal and construct validity in tests of assumed causal models that have not been covered in previous work.

In school improvement studies, randomized experiments are rare. A special problem is the assignment to the experimental and control groups, taking into account the different starting conditions at the schools in terms of school improvement competencies. The purpose of this paper is to take the example of an intervention study conducted in Baden-Württemberg, Germany, the extent to which the challenges involved with a quasi-experimental design were addressed is examined.

The intervention study was conducted with 54 math teachers (experimental group: n=29; control group: n=25) and their grade 7 and 8 classes (n=1,054) at 13 secondary schools. It aimed to increase teacher cooperation on teaching for promotion of students’ self-regulated learning. T-tests, Mann-Whitney tests, ANOVA, multilevel regression analyses were conducted.

At the beginning of the intervention, the teachers in the two groups did not differ significantly in prior cooperation on teaching processes and in attitudes toward cooperation. However, they differed in prior cooperation on school framework conditions and teaching processes. The intervention was effective in increasing teachers’ cooperation intensity on instruction, and teachers’ attitude toward binding cooperation. However, teaching processes did not change depending on experimental or control group.

Teacher cooperation practice was assessed only by teachers’ self-report. No indicators on the quality of the cooperation among teachers were included.

The paper discusses the challenges and limitations of conducting intervention studies on school improvement. Implications for further research are given.

This paper fulfils an identified need to study how quasi-experimental designs can be implemented in intervention studies on school improvement.

This chapter reports on a longitudinal quasi-experimental field study within an organizational design of a global consumer products manufacturer moving toward high-performance work systems (HPWSs) in North America by integrating business centers and self-directed work teams (SDWTs) coupled with 13 other action-levers within an integrated and bundled high-performance organizations (HPOs) re-design. The results of this organizational design effort are assessed using different types and levels of organizational outcomes (hard record data, behavioral, and attitudinal measures) along a 5-year temporal dimension punctuated by multiple time periods (baseline, during, and after). The organization, which was “built to change” (Lawler & Worley, 2006), in this research had already highly superior or “exemplar” (Collins, 2001) levels of organizational performance. Consequently, the real research question becomes: “What effect does state of the art organizational design and development have on an exemplar organization?” The study also calls into question the field's ability to truly assess exemplar organizations with existing measures of organizational change and development.