Search results

The purpose of this study is to characterize output and impact evaluation initiatives from the perspective of entrepreneurs and investors of social enterprises (SE) by highlighting their relevance, implementation processes and consequences.

This study adopted a qualitative approach through a multiple case study. This study also analyzed ten SE in five areas and three investors, using semi-structured interviews, codification and content analysis.

Evaluation is still at an initial stage in these businesses, and there is a gap between what the field-specific literature proposes and what firms do. Although entrepreneurs feel that evaluation is essential to demonstrate their value and confirm their purpose and impact, it is not a priority.

Due to the small number of Brazilian enterprises and investors, it is impossible to generalize the results.

The results are relevant to rethink strategies, processes and methodological tools that seek to portray, more realistically and reliably, the evaluation dimensions in SE.

This study highlights the risk regarding the legitimacy of social impact ventures since, without the due causal inferences, it is not easy to prove the impact they claim to achieve. This situation conducts to the weakening of the ecosystem leading to the emptying of the term impact.

The main research contributions address the methodologies, practices and evaluation routines of some Brazilian SE and their investors, presenting the characteristics, perceptions and limitations of the studied ventures.

English social housing providers are increasingly turning to social impact measurement to assess their social value. This paper aims to understand the contextual factors causing this rise in the practice, specifically within this sector; the mechanisms that enable it to be effectively implemented within an individual organisation and the outcomes of successful implementation for individual organisations and more widely across the sector and beyond.

A realist theory-based approach is applied to the study of a small number of social housing organisations and leaders within the sector to explore the use of social impact measurement. The paper addresses three questions: Why is social impact measurement being adopted in this sector? How is it successfully implemented? And what happens (outcomes) when it is successfully implemented? Addressing these questions necessitates deeper insight into the contextual pressures that have brought to the fore social impact measurement within the sector and the beneficial outcomes the practice provides (or is anticipated to provide) to social housing providers. The methodological approach of Realist Evaluation (Pawson and Tilley, 1997, 2004) is used to structure and analyse the empirical data and findings into a programme theory for social impact measurement. Realist Evaluation provides a programme theory perspective, seeking to answer the question “what works, for whom and in what circumstances?”. In this research, the “whom” refers to English social housing providers and the circumstances are the contextual conditions experienced by the sector over the past decade. The programme theory aims to set out the links between the contextual drivers for social impact measurement, the mechanisms that bring about its implementation and the outcomes that occur as a result. Within this, greater detail on the implementation perspective is provided by developing an implementation theory using a Theory of Change approach (Connell et al., 1995; Fulbright-Anderson et al., 1998). The implementation theory is then embedded within the wider programme theory so as to bring the two elements together, thereby creating a refinement of the overall theory for social impact measurement. In turn, this paper demonstrates its importance (the outcomes that it can achieve for organisations and the sector) and how it can effectively be implemented to bring about those outcomes.

Social housing providers use social impact measurement both internally, to determine their organisational priorities and externally, to demonstrate their value to local and national governments and cross-sector partners then to shape and influence resource allocation. The practice itself is shown to be an open and active programme, rather than a fixed calculative practice.

The intensive nature of the research means that only a limited number of cases were explored. Further research could test theories developed here against evidence collected from a wider range of cases, e.g. other types of providers or non-adopters.

The research makes a strong contribution to practice in the form of a re-conceptualisation of how social impact measurement can be shown to be effective, based on a deeper understanding of causal mechanisms, how they interact and the outcomes that result. This is of value to the sector as such information could help other organisations both to understand the value of social impact measurement and to provide practical guidance on how to implement it effectively.

As the practice of impact measurement continues to develop, practitioners will need to be aware of any changes to these contextual factors and consider questions such as: is the context still supportive of impact measurement? Does the practice need to be adjusted to meet the needs of the current context? For instance, the recent tragedy at Grenfell Tower has led to a reconsideration of the role of social housing; a new Green Paper is currently being drafted (Ministry for Housing, Communities and Local Government, 2018). This may have a number of implications for social impact measurement, such as a rebalancing of emphasis on outcomes relating to environmental improvements, towards outcomes relating to the well-being of tenants.

Existing literature is largely limited to technical guides. This paper links theory-based evaluation to practice contributing to social housing practice.

This paper aims to report a research approach that explores how to use evaluations of previous social marketing efforts to assess and guide a new shelterbelt program called Working Tree. By targeting farmers, this new program aims to gain benefits from enhancing and expanding on-farm tree shelterbelts on the Canadian prairies.

This paper uses a novel method that relies on secondary data from six completed social marketing cases as data for a comparative analysis with the new program. A conceptual framework is proposed and applied. This framework incorporates process and outcome indicators of evaluation, key dimensions of the rational choice theory and proven practices from experience.

Analysis suggests key parameters of the Working Tree program to be appropriate, with some modifications. However, limitations in the data also point to avenues for future research to deepen the authors’ understanding of assessing a new social marketing program in the prelaunch phase. More research is needed on what works, where and why.

The seven indices are a modest set for comparatives and are not exhaustive. Six selected cases are small samples that are unable to fully reflect the environmental nature of the new program; yet, they contained critical data for the comparative analysis. Financial data are not in constant dollars, which would be needed when further analysis is undertaken.

This paper illustrates the importance of the evaluation stage of the social marketing process. It demonstrates the practicality of being able to effectively draw upon previous evaluations to inform new program investors and social marketers at the prelaunch stage.

The conceptual framework and method present a novel approach to use evaluation data to guide new program funding and initiatives. It is offered with the hope that others might draw upon the ideas presented here and advance them.

For social marketers to become effective change agents, evaluation is important. This paper aims to expand existing evaluation work to empirically respond to Gordon and Gurrieri’s request for a reflexive turn in social marketing using reflexive process evaluations: measuring more than “what” worked well, but also evaluating “how” and “why” success or indeed failure happened.

An online survey, adapting Dillman’s tailored design method empirically assesses 13 reflexive process hypotheses. With a response rate of 74 per cent, regression analysis was conducted to evaluate the proposed hypotheses and to identify the significant predictors of each of the reflexive process relationships under investigation.

The study empirically examines and shows support for three reflexive process evaluation constructs – relationships, knowledge and networking. Network involvement and reciprocity; two process dimension constructs do not exert any impact or predict any relationship in the conceptual framework.

This paper expands evaluation theory and practice by offering a conceptual framework for reflexive process evaluation that supports the logic to be reflexive. It shows support for three reflective process evaluation constructs – relationships, knowledge and networks. Another unique element featured in this study is the empirical assessment of Gordon and Gurrieri’s “other stakeholders”, extending evaluations beyond a traditional client focus to an interconnected assessment of researchers, clients and other stakeholders.

Based on the perspective of stakeholders, this paper aims to construct the corporate social responsibility (CSR) evaluation system, aiming at encouraging enterprises to actively undertake social responsibility, formulating targeted countermeasures to improve the performance level of social responsibility and realizing its sustainable development.

The study uses data from 2014 to 2018 of pharmaceutical companies in China to estimate the CSR system. Based on the analytic hierarchy process, the coefficient of variation uses to determine the weight of each index. Moreover, the cloud model uses for empirical evaluation.

The results reveal that social responsibility evaluation of pharmaceutical companies is poor to average to good and it maintains a good development trend. The order of the weight of corporate stakeholders is shareholders, employees, consumers, creditors, suppliers and government. The importance of internal stakeholders is higher than that of external stakeholders. The comprehensive cloud evaluation value of the social responsibility evaluation of pharmaceutical companies are “ordinary,” and the effect of comprehensive social responsibility performance is not good.

The current study not only considers the uncertainty of the concept of CSR but also reflects the connection between the randomness of pharmaceutical companies and the ambiguity of CSR. Moreover, this study develops a three-dimensional evaluation of “enterprise-year-indicator” by studying the data of multiple companies in different years. In terms of the modeling concept, the two-way cognition between the connotation and conceptual extension of the cloud model is fully used to realize the uncertainty mapping between the evaluation set and the indicator set.

As organisations are increasing their investment in social media marketing (SMM), evaluation of such techniques is becoming increasingly important. The purpose of this paper is to contribute to knowledge regarding SMM strategy by developing a stage model of SMM evaluation and uncovering the challenges in this process.

Interviews were conducted with 18 key informants working for specialist SMM agencies. Such informants are a particularly rich source, since they manage social media campaigns for a wide range of clients. An exploratory research was conducted and thematic analysis surfaced the key components of the SMM evaluation process and associated challenges.

The SMM evaluation framework is developed. This framework has the following six stages: setting evaluation objectives, identifying key performance indicators (KPIs), identifying metrics, data collection and analysis, report generation and management decision making. Challenges associated with each stage of the framework are identified, and discussed with a view to better understanding decision making associated with social media strategies. Two key challenges are the agency-client relationship and the available social analytics tools.

Despite an increasing body of research on social media objectives, KPIs and metrics, no previous study has explored how these components are embedded in a marketing campaign planning process. The paper also offers insights in the factors that make SMM evaluation complex and challenging. Recommendations for further research and practice are offered.

The aim of this paper is to determine the criteria for a solid impact evaluation in social entrepreneurship. The solid impact evaluation method is needed for building the bridge between two separate discourses of social entrepreneurship: the discourses of protectionists of social entrepreneurship, who believe without empirical proof that social enterprises are effective and the opponents or doubters in social entrepreneurship, who need empirical proof of the effectiveness of social enterprises.

The criteria for a solid impact evaluation discourse of social entrepreneurship are determined and its impact evaluation is analysed based on literature.

A solid social impact evaluation method should be able to analyse: the social impact of the organisation and not only the financial allocation and outcome; differences in the impact of two organisations which are operating in the same field; and the selection of target group and analysis of all the impacts of the activities.

The list of criteria for a solid impact evaluation might not be complete as it is based on literature review only. As there is a considerable gap between the discourse of protectionists and opponents of social entrepreneurship, additional analyses are required to analyse the discourse of practitioners of social entrepreneurship.

The current study could be used for practitioners as well as for politicians while preparation for the negotiations with the representatives with other sectors as it brings out some of the common topics that are misunderstood by different parties.

This paper takes the first step toward a construction of a solid impact evaluation model. Evaluating the social impact of social enterprises with a solid model could bring closer the discourses of social enterprises used by protectionists and opponents of social entrepreneurship.

The purpose of this study is to explore informetrics researchers' use of social media for academic activities, their attitudes to the applicability of altmetrics in research evaluation, the factors influencing their attitudes, and the main opportunities and weaknesses of using altmetrics.

A survey using a questionnaire was conducted with researchers who participated in the 16th International Conference on Scientometrics and Informetrics ISSI 2017 and a sample of 125 respondents was obtained.

Progressively more researchers are using social media for different types of academic activities. The study found that many factors affect informetrics researchers' attitudes in different application scenarios with respect to research evaluation. Researchers who have studied altmetrics and who began using social media platforms recently or frequently have more positive attitudes. Academic users and social users have statistically significantly disparate attitudes toward altmetrics in different disciplines and different application scenarios.

Our study only focused on 125 informetrics researchers, who participated in ISSI 2017. We mainly used the questionnaire method, but did not conduct in-depth interviews with the researcher's views.

Informetrics researchers are participants in social media and major researchers of altmetrics. Previous research has examined their use of social media, and this study combines this use of social media with their attitudes to altmetrics to explore the value of altmetrics from a particular perspective. The paper also provides suggestions for the application of altmetrics in research evaluation.

This study aimed to analyze existing problems in the dissemination and management of emergency information on social media platforms, improve social media users' experience regarding such information, increase the efficiency of emergency information dissemination and curb the spread of misinformation.

In this study, the emergency information quality on social media platforms was examined. Based on the evaluation principles of the quality of mature information, social media information characteristics and the rules of emergency information dissemination, combined with relevant academic research results, an index to evaluate the quality of emergency information on social media was constructed. In addition, the authors have introduced cloud theory as an information quality evaluation method and used social media users' emotional characteristics to assess information quality evaluation results. A comprehensive system for evaluating emergency information quality, including indexes, methods and detection strategies was established. Based on a comprehensive system, a case study was conducted on the forest fires in Sichuan Province and the African swine fever events as reported on the Zhihu platform. In accordance with the results of the case study, the authors expanded the research and introduced the emotional characteristics of social media users as an independent evaluation dimension to evaluate the quality of emergency information on social media.

The comprehensive system's effectiveness was verified through the case study. Further, it was found that users' emotional characteristics (reflected in their information behavior) are inconsistent with their evaluation of websites' information quality regarding major emergencies. Integrating users' emotional characteristics into the information evaluation system can enhance its effectiveness following major emergencies.

First, an evaluation index system of emergency information quality on social media about major emergencies was offered. Unlike the commonly available index system for information quality evaluation, this proposed evaluation index system not only accounted for the characteristics of social media, such as massive disordered information, multiple information sources and rapid dissemination, but also for the characteristics of emergency events, such as variability and the absence of precursors. This proposed evaluation index system enhances the pertinence of the information quality evaluation and compensates for the shortcoming that the current research only focuses on evaluating social media information quality in a broad context, but pays insufficient attention to major emergencies. Second, cloud theory was introduced as a method to evaluate the emergency information quality found on social media. Existing research has primarily included the use of traditional statistical methods, which cannot transform numerical values into qualitative concepts effectively. Various indeterminate factors inevitably affect the quality of emergency information on social media platforms, and the traditional methods cannot eliminate this uncertainty in the evaluation process. The method to assess emergency information quality based on cloud theory can effectively compensate for the gaps in the research and improve the accuracy of information quality assessment. Third, the inspection and the dynamic adjustment of assessment results are absent in the research on information quality assessment, and the research has relied principally on the information users' evaluation and has paid insufficient attention to their attitudes and behaviors toward information. Therefore, the authors incorporated users' emotional characteristics into the evaluation of emergency information quality on social media and used them to test the evaluation results so that the results of the information quality assessment not only include the users' explicit attitudes but also their implicit attitudes. This enhances the effectiveness of the information quality assessment system. Finally, through this case study, it was found that an inconsistency exists between user evaluation and user emotional characteristics after major emergencies. The reasons for this phenomenon were explained, and the necessity of integrating user emotional characteristics into information quality assessment was demonstrated. Based on this, the users' emotional characteristics were used as a separate evaluation dimension for assessing the quality of emergency information on social media. Compared with assessing the quality of general information, integrating the user's emotional characteristics into the evaluation index system can lead the evaluation results to include not only the users' cognitive evaluation but also their emotional experience, further enhancing their adaptability.

Improvement in the evaluation methodologies used in the public policy and development fields has increased the amount of evidence-based information available to decision makers. This helps firms evaluate the impacts of their social investments. However, it is not clear whether the business sector is interested in using these methods. This paper aims to describe the level of interest in, knowledge of and preferences relating to the impact evaluation of corporate social responsibility (CSR) programs by managers in Latin American companies and foundations.

A survey of 115 companies and foundations in 15 countries in Latin America was conducted in 2019.

The results indicated that most respondents believed that quantitative impact evaluation could address concerns about CSR program outcomes. However, monitoring and evaluation were primarily seen to be for tracking program objectives rather than for making strategic decisions about innovations to enhance the achievement of outcomes. Decision-making tended to respond to community demands. The main challenges to increasing the use of impact evaluation were the lack of skills and knowledge of management staff and the methodological complexity of evaluation designs. We conclude that there needs to be increased awareness about: the appropriate understanding of social outcomes; the benefits of evaluation; when impact evaluation is useful; how to prepare an evaluation budget; and the effective use of rigorous evidence to inform program design.

Acceptance by the business sector of quantitative measurement of the social impact of CSR programs will lead to improved outcomes from social investment programs.