Replication in Experimental Economics: Volume 18
Table of contents
(15 chapters)Part I: Introduction
Part II: Direct Replication
Abstract
This paper replicates four highly cited, classic lab experimental studies in the provision of public goods. The studies consider the impact of marginal per capita return and group size; framing (as donating to or taking from the public good); the role of confusion in the public goods game; and the effectiveness of peer punishment. Considerable attention has focused recently on the problem of publication bias, selective reporting, and the importance of research transparency in social sciences. Replication is at the core of any scientific process and replication studies offer an opportunity to reevaluate, confirm or falsify previous findings. This paper illustrates the value of replication in experimental economics. The experiments were conducted as class projects for a PhD course in experimental economics, and follow exact instructions from the original studies and current standard protocols for lab experiments in economics. Most results show the same pattern as the original studies, but in all cases with smaller treatment effects and lower statistical significance, sometimes falling below accepted levels of significance. In addition, we document a “Texas effect,” with subjects consistently exhibiting higher levels of contributions and lower free-riding than in the original studies. This research offers new evidence on the attenuation effect in replications, well documented in other disciplines and from which experimental economics is not immune. It also opens the discussion over the influence of unobserved heterogeneity in institutional environments and subject pools that can affect lab results.
Abstract
Shang and Croson (2009) found that providing information about the donation decisions of others can have a positive impact on individual donations to public radio. In this study, we attempted to replicate their results, but found no evidence that social information affected donation decisions. However, most of our donors were renewing members, a group which Shang and Croson also found was not influenced by social information.
Part III: Replication As a Basis for Extension
Abstract
This study first replicates, then perturbs, the centipede game as implemented by McKelvey and Palfrey (1992). It is thus both a replication study and an original research study. We use controlled laboratory experiments, with computer interfaces for each treatment, anonymous round-robin matching among the subjects across rounds, multiple (10) rounds within each treatment, and incremental changes between adjacent treatments allowing for an assessment of effects at the margin of different game configurations. We find unraveling to the subgame perfect equilibrium somewhat faster than did McKelvey and Palfrey (1992), when using their exact design. Perturbations to that design show that setting non-taker payoffs to zero induces earlier unraveling, as does the use of higher stakes (as in Murphy, Rapoport, and Parco (2006), and Rapoport, Stein, Parco, and Nicholas (2003), respectively). Other, subsequent perturbations show: that there is at most a subtle effect associated with using a 10-second timer with a default move, relative to untimed active moves; and that clock format versus tree format has a minimal effect in common information, unchanging payoff-parameterization environments. We verify the robustness of some key past findings in real-time games. We also explore in a common information environment, the effect of design features previously used in independent private values settings; here we find new evidence that features which might modulate information acquisition and/or processing in an independent private values setting may not restrict behavior in a common information setting.
Abstract
We replicate and extend the social history treatment of the Berg, Dickhaut, and McCabe (1995) investment game, to further document how the reporting of financial history influences how laboratory societies organize themselves over time. We replicate Berg et al. (1995) by conducting a No History and a Financial History session to determine whether a report summarizing the financial transactions of a previous experimental session will significantly reduce entropy in the amounts sent by Investors and returned by Stewards in the investment game, as Berg et al. (1995) found. We extend Berg et al. (1995) in two ways. First, we conduct a total of five sessions (one No History and four Financial History sessions). Second, we introduce Shannon’s (1948) measure of entropy from information theory to assess whether the introduction of financial transaction history reduces the amount of dispersion in the amounts invested and returned across generations of players. Results across sessions indicate that entropy declined in both the amounts sent by Investors and the percentage returned by Stewards, but these patterns are weaker and mixed compared to those in the Berg et al. (1995) study. Additional research is needed to test how initial conditions, path dependencies, actors’ strategic reasoning about others’ behavior, multiple sessions, and communication may mediate the impact of financial history. The study’s multiple successive Financial History sessions and entropy measure are new to the investment game literature.
Abstract
Does social-isolation deflate observed preferences for public goods? Using a voting referendum elicitation mechanism, List et al. (2004) document a 30% reduction in affirmative voting when votes are privately, rather than publicly, cast for a public good. We replicate this work and then add to the exercise by examining the role that group size plays in generating social-pressure bias – an extension we motivate with a structural model. Having replicated to the extent possible the List et al.’s consequential private and public treatments, we find that when group size is large (N = 60), social isolation reduces affirmative votes by roughly 30%, a result that does not carry over to the small-group (N = 30) session.
Abstract
Recent experiments show that feedback transmission can mitigate opportunistic behavior in repeated social dilemmas. Two nonexcludable explanations have been investigated: strategic signaling and nonmonetary sanctioning. This literature builds on the intuition that under both partner matching (where the same groups of players interact many times) and stranger matching (where groups change continuously), feedback may work as a nonmonetary sanctioning device, but only the former also allows for strategic signaling. Empirical evidence on the two explanations is mixed. Moreover, the usual design may give rise to confounding matching protocol effects.
My experiment provides a novel empirical testbed for different channels by which feedback – costless disapproval points – may affect behavior in a repeated public goods game. In particular, it is based on a random matching scheme that neutralizes the confounding effects of different matching protocols on behavior.
The transmission of feedback is found to foster prosocial behavior. The data favor the nonmonetary sanctioning explanation rather than the signaling hypothesis.
This study provides a novel set of evidence that (i) communication may mitigate selfishness in social dilemmas and (ii) the source of this phenomenon may be linked to the emotional reaction that communication evokes in humans.
Abstract
This paper replicates and refines the finding that subsidies for charitable contributions of a rebate type are less effective than matching subsidies. A survey based field experiment with health charities was conducted among a national sample representative of the Dutch population on key demographic characteristics. The greater effectiveness of matching subsidies found in laboratory experiments is replicated. Also some evidence is provided on why matches are more effective than rebates. Matches attract a larger pool of donors, in part because donors expect more people to make donations and “join in.” Matches also increase the amount contributed among the higher educated, higher income households and larger donors. Subsidies of either type do not decrease subsequent giving in a campaign for tsunami relief. The experiment could not test whether the greater effectiveness of a matching subsidy is due to a change in the donor’s attention to the benefits of a donation to the cause. This explanation should be tested in future research. The findings imply that a given budget available to subsidize charitable contributions can be used more effectively if the subsidy is framed in the form of a match than in the form of a rebate. Nonprofit organizations can use this insight in the design of fundraising campaigns. For governments the finding suggests that the effectiveness of current subsidies for charitable contributions can be enhanced by matching them rather than providing a deduction in the income tax, which works as a rebate.
Part IV: Looking Forward
Abstract
Efforts in the spirit of this special issue aim at improving the reproducibility of experimental economics, in response to the recent discussions regarding the “research reproducibility crisis.” We put this endeavor in perspective by summarizing the main ways (to our knowledge) that have been proposed – by researchers from several disciplines – to alleviate the problem. We discuss the scope for economic theory to contribute to evaluating the proposals. We argue that a potential key impediment to replication is the expectation of negative reactions by the authors of the individual study, and suggest that incentives for having one’s work replicated should increase.
- DOI
- 10.1108/S0193-2306201518
- Publication date
- 2015-10-13
- Book series
- Research in Experimental Economics
- Editors
- Series copyright holder
- Emerald Publishing Limited
- ISBN
- 978-1-78560-351-8
- eISBN
- 978-1-78560-350-1
- Book series ISSN
- 0193-2306