Search results

This aim of this paper is to examine the existing gender digital inclusion evaluation guidance and proposes future research recommendations for their evaluation. Despite modern progress in towards gender equality and women’s empowerment movements, women’s access to, use of and benefits from digital technologies remain limited owing to economic, social and cultural obstacles. Addressing the existing gender digital divide is critical in the global efforts towards the United Nations’ Sustainable Development Goals (SDGs). In recent years, there has been a global increase of gender digital inclusion programmes for girls and women; these programmes serve as a mechanism to learn about gender-specific digital needs and inform future digital inclusion efforts. Evaluation reports of gender digital inclusion programmes can produce critical insights into girls’ and women’s learning needs and aspirations, including what works and what does not when engaging girls and women in information and communications technologies. While there are many accounts highlighting the importance of why gender digital inclusion programmes are important, there is limited knowledge on how to evaluate their impact.

The thematic analysis suggests three points to consider for the gender digital inclusion programmes evaluation: context-specific understanding of gender digital inclusion programmes; transparency and accountability of the evaluation process and its results; and tensions between evaluation targets and empowerment of evaluation participants.

The thematic analysis suggests three points of future focus for this evaluation process: context-specific understanding of gender digital inclusion programmes; transparency and accountability of the evaluation process and its results; and tensions between evaluation targets and empowerment of evaluation participants.

The authors propose recommendations for gender digital inclusion evaluation practice and areas for future research.

Evaluation and measurement (E&M) remains a critical and debated topic among communication scholars and practice. Substantial research and professional efforts have been devoted to discussing what should be measured and which methods should be applied. Most of the E&M models seem to carry a positivist imprint. But, in real-life, organizations could not have clear aims, enough resources, or adequate informative systems to support E&M. Moreover, several contextual factors could affect the implementation of E&M management processes. The communication literature rarely highlights these factors. To fulfill this gap, the purpose of this paper is to theorize the contextual factors relevant to the management of the evaluation process.

A scoping literature review was carried out exploring the role of contextual factors and impact of contextual factors on E&M management processes. More specifically, the review examines the contribution provided by program evaluation and performance measurement (PM) fields of research.

The paper provides a scoping review of program evaluation and PM approaches. Additionally, it explains how both streams of thought argued the importance of contextual factors, such as organizational, relational, cultural and communicative factors, for the success of any evaluation processes. The study underlined that the main evaluation models used in the field of communication have overlooked these studies and put on evidence the role of contextual factors in effectively executing communication E&M.

The paper enriches the dominant rationale concerning the E&M management processes by incorporating literature on: program evaluation; and PM. The analysis could provide useful insights also from a professional perspective, by helping practitioners for a contextual assessment of strategic communication programs and activities.

Aims to review the literature on evaluation and to examine research, theory and practice in relation to two key questions: What is evaluation and What is its contribution? Evaluation is increasingly a contemporary concern owing to growing demand for verification of programme results and the current political and economic climate. With the growth in evaluation activity in diverse fields, especially within new domains, those involved in health‐care delivery can benefit from an overview of the universal fundamentals of research and theory that translate into improved practice. To evaluate effectively, there is a need for a full understanding of evaluation’s nature, purposes and concepts. Identifies and reviews the key sub‐domains of evaluation, namely: definitions; theoretical underpinning; formulation of goals and objectives; specification of the programme; and cost‐benefit analysis.

Educational leadership preparation programs are expected to train graduates who change their practice and produce outcomes for teachers and students. However, programs are challenged to produce evidence of their impact while also evaluating for formative purposes. This paper describes collaboration between an educational leadership program director and a program evaluator to construct an evaluation system that incorporated program theory, processes, and outcomes. The leadership preparation program, grounded in ethical leadership practices, had a unique design with core tenets that informed choices about the evaluation design. Decisions about data sources were informed by evaluation foci, the availability of existing data sources, and resource constraints. The complexity of the evaluation design paralleled the complexity of the program itself. Leadership content expertise, evaluation design expertise, and genuine collaboration were all essential to the successful design of this evaluation plan. Several recommendations are offered for others collaborating to design evaluations of their programs.

Improvement in the evaluation methodologies used in the public policy and development fields has increased the amount of evidence-based information available to decision makers. This helps firms evaluate the impacts of their social investments. However, it is not clear whether the business sector is interested in using these methods. This paper aims to describe the level of interest in, knowledge of and preferences relating to the impact evaluation of corporate social responsibility (CSR) programs by managers in Latin American companies and foundations.

A survey of 115 companies and foundations in 15 countries in Latin America was conducted in 2019.

The results indicated that most respondents believed that quantitative impact evaluation could address concerns about CSR program outcomes. However, monitoring and evaluation were primarily seen to be for tracking program objectives rather than for making strategic decisions about innovations to enhance the achievement of outcomes. Decision-making tended to respond to community demands. The main challenges to increasing the use of impact evaluation were the lack of skills and knowledge of management staff and the methodological complexity of evaluation designs. We conclude that there needs to be increased awareness about: the appropriate understanding of social outcomes; the benefits of evaluation; when impact evaluation is useful; how to prepare an evaluation budget; and the effective use of rigorous evidence to inform program design.

Acceptance by the business sector of quantitative measurement of the social impact of CSR programs will lead to improved outcomes from social investment programs.

The purpose of this paper is to describe the evolving IFLA approach to impact evaluation through three of its international programmes: Freedom of Access to Information, Building Strong Library Associations (BSLA) and the International Advocacy Programme (IAP). This review positions these three programmes within the wider discourse of the international evaluation community.

Each of the three programmes is considered in turn to show what they were trying to achieve and how thinking about impact evaluation at IFLA is evolving.

This paper reports key evaluation findings for relevant phases of the BSLA and IAP programmes in general terms.

The views presented are those of the evaluation consultants who advised each of these programmes (and in the cases of BSLA and the IAP conducted the programme evaluations).

The processes described and the conclusions drawn should be of interest to anyone involved in international or national library evaluation, especially of public libraries, library associations and national libraries.

The paper suggests that more systematic impact evaluation of public libraries, library associations and national libraries is necessary to ensure their future survival.

The authors were uniquely placed to see and participate in IFLA impact evaluation discussions over the past decade.

The purpose of this chapter is to discuss theory-based evaluation of public–private partnership (PPP) projects/programmes and to develop an intervention logical framework. It aims to draw attention to the need to go beyond the measurement of project/programme results to address not only the question of whether or not the project/programme worked but also the how and why questions. The study follows an interpretative methodology. It analytically discloses the mechanics of theory-based evaluation in relation to a ‘PPP theory’ and describes a theory-based analytical framework that portrays an explicit path towards ultimate impacts so as to assess, in a more systematic and integrated way, the success or failure of a PPP. Theory-based evaluation is a promising evaluation approach that would fit into the complexities of PPP projects/programmes and would expand the available toolbox of evaluators. Proper use of theory-based evaluation in PPP interventions contributes to better policy formulation and project implementation, thus leading to improved socio-economic benefits derived from PPP projects and programmes. The main contribution of the study is that it develops a ‘PPP theory’ and a related logical intervention framework drawing on theory-based approaches. Although the framework is developed for a representative sector, transport, it can easily be applied to any other PPP intervention.

The study here helps to fill the gap between the current practices of management performance audits for firms and government agencies. The study advances recent theories of program evaluation and marketing management auditing. While the application in this chapter refers to government agencies managing destination marketing programs (tourism agencies), the algorithmic model construction is applicable for all management audits. The study applies the perspectives from two streams of theory to describe five relevant activities for managing destination marketing programs: scanning, planning, implementation, assessing, and administering. The analysis proposes impact assessments to improve management performances of DMOs via checklists for assessing the quality of information in tourism-management performance audits. Checklists can serve as a management tool by management performance auditors and by DMO executives to enhance the quality in executing destination marketing programs. A meta-evaluation of 10 tourism management audit reports identifies good and bad practices. The findings indicate that substantial improvements are possible in the practice of DMO’s management performance auditing, and the proposed checklist may ensure both high quality performance audit reports and improved performances in DMO practices.

In this chapter, the author builds from foundational scholarship which suggests that service-learning yields positive outcomes for students, faculty, and community partners. The author first suggests that service-learning can be a vehicle for humanizing community partners as well as students, faculty, and course content, then describes a program evaluation context wherein community partners would benefit from a humanizing service-learning experience. The author then introduces the field of program evaluation and the foundational documents espoused by the American Evaluation Association, and looks at the organizational structure of the Department of Organizational Leadership, Policy, and Development at the University of Minnesota – Twin Cities, which houses the Evaluation Studies specialization. Next, the author presents a foundational program evaluation course, discussing its emphasis on service-learning and on humanizing the students, community partners, and course content, and introducing the textbooks, readings, and activities used to bring the experience to life. The author concludes by looking at opportunities and challenges to integrating program evaluation into a departmental core at other universities.

A meta-evaluation is an assessment of evaluation practices. Meta-evaluations include assessments of validity and usefulness of two or more studies that focus on the same issues. Every performance audit is grounded explicitly or implicitly in one or more theories of program evaluation. A deep understanding of alternative theories of program evaluation is helpful to gain clarity about sound auditing practices. We present a review of several theories of program evaluation.

This study includes a meta-evaluation of seven government audits on the efficiency and effectiveness of tourism departments and programs. The seven tourism-marketing performance audits are program evaluations for: Missouri, North Carolina, Tennessee, Minnesota, Australia, and two for Hawaii. The majority of these audits are negative performance assessments. Similarly, although these audits are more useful than none at all, the central conclusion of the meta-evaluation is that most of these audit reports are inadequate assessments. These audits are too limited in the issues examined; not sufficiently grounded in relevant evaluation theory and practice; and fail to include recommendations, that if implemented, would result in substantial increases in performance.