Search results

A meta-evaluation is an assessment of evaluation practices. Meta-evaluations include assessments of validity and usefulness of two or more studies that focus on the same issues. Every performance audit is grounded explicitly or implicitly in one or more theories of program evaluation. A deep understanding of alternative theories of program evaluation is helpful to gain clarity about sound auditing practices. We present a review of several theories of program evaluation.

This study includes a meta-evaluation of seven government audits on the efficiency and effectiveness of tourism departments and programs. The seven tourism-marketing performance audits are program evaluations for: Missouri, North Carolina, Tennessee, Minnesota, Australia, and two for Hawaii. The majority of these audits are negative performance assessments. Similarly, although these audits are more useful than none at all, the central conclusion of the meta-evaluation is that most of these audit reports are inadequate assessments. These audits are too limited in the issues examined; not sufficiently grounded in relevant evaluation theory and practice; and fail to include recommendations, that if implemented, would result in substantial increases in performance.

The study here helps to fill the gap between the current practices of management performance audits for firms and government agencies. The study advances recent theories of program evaluation and marketing management auditing. While the application in this chapter refers to government agencies managing destination marketing programs (tourism agencies), the algorithmic model construction is applicable for all management audits. The study applies the perspectives from two streams of theory to describe five relevant activities for managing destination marketing programs: scanning, planning, implementation, assessing, and administering. The analysis proposes impact assessments to improve management performances of DMOs via checklists for assessing the quality of information in tourism-management performance audits. Checklists can serve as a management tool by management performance auditors and by DMO executives to enhance the quality in executing destination marketing programs. A meta-evaluation of 10 tourism management audit reports identifies good and bad practices. The findings indicate that substantial improvements are possible in the practice of DMO’s management performance auditing, and the proposed checklist may ensure both high quality performance audit reports and improved performances in DMO practices.

The present chapter includes a case study that describes and analyzes three performance audit reports over a three decade period for one U.S. state government's destination management organization's (DMO) actions and outcomes. This report extends prior studies (Woodside & Sakai, 2001, 2003) that support two conclusions: (1) the available independent performance audits of DMOs’ actions and outcomes indicate that frequently DMOs perform poorly and fail to meaningfully assess the impacts of their own actions and (2) the audits themselves are shallow and often fail to provide information on DMOs’ actions and outcomes relating to these organizations largest marketing expenditures. The chapter calls for embracing a strategy shift in designing program evaluations by both government departments responsible for managing destinations’ tourism marketing programs and all government auditing agencies in conducting future management performance audits. The chapter offers a “tourism performance audit template” as a tool for both strategic planning by destination management organizations and for evaluating DMOs’ planning and implementing strategies. The chapter includes an appendix – a training exercise in using the audit template and invites the reader to download a tourism performance audit report of a destination marketing organization and to apply the template after reading the report.

Purpose – A structured comparison, based on underlying social ecological constructs, provides the framework for this preliminary investigation of the commonalities and differences between three emerging approaches to health disparities: community-based participatory research (CBPR), community-focused health outreach (CFHO), and community health promotion programs (CHPP).

Methodology/approach – A conceptual review and preliminary analysis at the macrolevel of major community trends that focus on eliminating health disparity outcomes.

Findings – Each of the three community health approaches share similar purposes using community-focused collaborative efforts, but involve different change agents, levels of partnership, timeframes, social participation, and implementation methodologies.

Research limitations/implications – Additional in-depth literature reviews and meta-evaluations highlighting the contributions of each of the three approaches (CPBR, CFHO, and CHPP) are strongly recommended.

Practical implications – Interested community stakeholders can monitor results and impacts of each of the three approaches within their environments.

Originality/value of paper – Past reviews have concentrated on isolating individual contributing social causes of health disparities. This analysis introduces three emerging trends that currently function within community-based frameworks as potential mechanisms for helping the health disadvantaged.

The pressure on higher education providers (HEPs) and national programme partnerships to evaluate the impact of widening participation (WP) interventions has intensified as a result of wider changes in higher education (HE) policy and regulation, including the imposition of market forces. This chapter describes how policy stakeholder assumptions about how evaluation works and the outcomes it delivers have evolved over the last two decades. It shows how regulatory emphasis has shifted from a focus on monitoring and tracking, through to a call for return-on-investment analysis, before falling back on a pragmatic theory-informed approach. This chapter goes on to locate WP evaluation in the middle of a paradigm war, caught between proponents of a medicalised trial-based conception of evaluation methodology, and a practitioner-led position, which points to the complex contextual character of WP activities. It continues by exploring some of the many practical challenges faced by WP evaluators and argues that these have contributed to the sector’s perceived failure to deliver robust evidence of the impact of fair access activity. This chapter concludes with a look at the expanding market for WP evaluation products and services, which emerged in response to new flows of WP investment created by the 2012 increase in tuition fees.

This chapter gives one version of the recent history of evaluation case study. It looks back over the emergence of case study as a sociological method, developed in the early years of the 20th Century and celebrated and elaborated by the Chicago School of urban sociology at Chicago University, starting throughout the 1920s and 1930s. Some of the basic methods, including constant comparison, were generated at that time. Only partly influenced by this methodological movement, an alliance between an Illinois-based team in the United States and a team at the University of East Anglia in the United Kingdom recast the case method as a key tool for the evaluation of social and educational programmes.

Consumer behavior in tourism (CBT) is an interdisciplinary field of study encompassing the basic behavioral and economic sciences (e.g., psychology, sociology, and economics) and applied fields of study (e.g., management, marketing, tourism, and hospitality) focusing on all aspects of discretionary travel. This chapter describes major issues and findings in the literature relating to CBT. The chapter directs the reader’s attention to some of the highly-cited studies in this literature – these studies provide a foundation of knowledge on the central topics, issues, methods, findings, and theoretical/practical contributions in research on CBT. Research studies in CBT focus on one-to-all five core theoretical issues in basic and applied fields of study: describe who is doing what, when, where, how, and the consequences of the activities; explain the meanings of activities and motivations of the actors; predict (model) what actions and outcomes will occur and the impacts of influence attempts before, during, and after engaging in tourist actions; control (influence) the beliefs, attitudes, behaviors, and assessments of tourists, local community members, and additional stakeholders; evaluate tourism service/product delivery, tourism management performance, and customer satisfaction. Survey research using verbal (written) responses to questions is pervasive and the most frequent method for data collection in CBT. Additional research genres in CBT include direct observations of tourism behavior with or without some oral questioning (unobtrusive studies, the long interview method (McCracken, 1988), use of “consumer culture theory”), participant observation including semester abroad and unpaid internships away from home, formal field experiments, and the study of secondary sources (e.g., photographs and writings in blogs and social media (e.g., TripAdvisor) reviews).