Search results

This chapter explores the relevance of critical race theory (CRT) and queer theory to the relational aspects of program evaluation. Often conceptual binaries that undergird traditional evaluation theory and practice (e.g., internal versus external evaluation, subjective versus objective analysis, observation versus intervention, and insider versus outsider positionalities) adversely influence rigid social roles between evaluator and participant limit a study's effectiveness in supporting programs for equity in contemporary school districts. To illustrate this approach, an array of problems within a program evaluation of a district-wide ethnic studies reform initiative is presented. Approaches to these challenges rooted in tenets of CRT and queer theory illustrate how the district was able to clarify goals and develop an effective implementation plan that focused on effective ethnic studies curriculum and pedagogy.

The purpose of this study is to carry out a systematic literature review for evidence-based assessment of the effectiveness of thesaurus in digital information retrieval systems. It also aimed to identify the evaluation methods, evaluation measures and data collection tools which may be used in evaluating digital information retrieval systems.

A systematic literature review (SLR) of 344 publications from LISA and 238 from Scopus has been carried out to identify the evaluation studies for analysis, and 15 evaluation studies have been analyzed.

This study presents evidences for the effectiveness of thesaurus in digital information retrieval systems. Various methods for evaluating digital information systems have been identified. Also, a wide range of evaluation measures and data collection tools have been identified.

The study was limited to the literature published in English language and indexed in LISA and Scopus. The evaluation methods, evaluation measures and data collection tools identified in this study may be used to design more cognizant evaluation studies for digital information retrieval systems.

The findings have significant implications for the administrators of any type of digital information retrieval systems in making more informed decisions toward implementation of thesaurus in resource description and access to digital collections.

This study extends our knowledge on the potentials of thesauri in digital information retrieval systems. It also provides cues for designing more cognizant evaluation studies for digital information systems.

This chapter gives one version of the recent history of evaluation case study. It looks back over the emergence of case study as a sociological method, developed in the early years of the 20th Century and celebrated and elaborated by the Chicago School of urban sociology at Chicago University, starting throughout the 1920s and 1930s. Some of the basic methods, including constant comparison, were generated at that time. Only partly influenced by this methodological movement, an alliance between an Illinois-based team in the United States and a team at the University of East Anglia in the United Kingdom recast the case method as a key tool for the evaluation of social and educational programmes.

The purpose of this study is to compare the evaluation of search result lists and documents, in particular evaluation criteria, elements, association between criteria and elements, pre/post and evaluation activities, and the time spent on evaluation.

The study analyzed the data collected from 31 general users through prequestionnaires, think aloud protocols and logs, and post questionnaires. Types of evaluation criteria, elements, associations between criteria and elements, evaluation activities and their associated pre/post activities, and time were analyzed based on open coding.

The study identifies the similarities and differences of list and document evaluation by analyzing 21 evaluation criteria applied, 13 evaluation elements examined, pre/post and evaluation activities performed and time spent. In addition, the authors also explored the time spent in evaluating lists and documents for different types of tasks.

This study helps researchers understand the nature of list and document evaluation. Additionally, this study connects elements that participants examined to criteria they applied, and further reveals problems associated with the lack of integration between list and document evaluation. The findings of this study suggest more elements, especially at list level, be available to support users applying their evaluation criteria. Integration of list and document evaluation and integration of pre, evaluation and post evaluation activities for the interface design is the absolute solution for effective evaluation.

This study fills a gap in current research in relation to the comparison of list and document evaluation.

The purpose of this paper is to provide an input‐output analysis of electronic resources in academic libraries by verifying evaluation indicators and applying them to the digital library environment.

This study measures the performance of electronic resources in academic libraries in Korea. To measure the efficiency of the input‐output ratio, evaluation indicators were divided into inputs and outputs. Inputs refer to the e‐resource use environment as well as the acquisition of e‐resources such as web DB, e‐books, e‐journals, and so on. Outputs quantify the use of each resource.

First, the results of this study show that a large share of academic library budgets is spent on e‐resource purchases and e‐resource environment improvement for better use. Second, the measurement shows that web DB subscription, annual e‐resource development, and education for e‐resource exhibit higher efficiency, while e‐resource use, web DB and e‐journal download exhibited relatively high efficiency. Third, when the input‐output ratio is calculated in percentage terms, the efficiency of e‐resources of Korean academic libraries reaches 88.20 per cent.

First, to measure performance accurately, results/effectiveness must be included. However, this study focused on quantifiable input and output factors. It is recommended that future research include user satisfaction and learning effects. Second, this study was conducted in a particular country (Korea). So it is advisable to conduct research to compare the results of this study to results in other countries.

This study is the first research to consider the performance of electronic resources in depth. This paper contributes to improving the reliability of library evaluation.

Changes in the format of library materials, increased amounts of information, and the speed at which information is being produced have created an unrelenting need for training for library staff members. Additionally, library employees are retiring in greater numbers and their accompanying expertise is being lost. The purpose of this study was to document evaluation practices currently used in library training and continuing education programs for library employees, including metrics used in calculating return-on-investment (ROI). This research project asked 272 library training professionals to identify how they evaluate training, what kind of training evaluation practices are in place, how they select programs to evaluate for ROI, and what criteria are important in determining an effective method for calculating ROI.

A meta-evaluation is an assessment of evaluation practices. Meta-evaluations include assessments of validity and usefulness of two or more studies that focus on the same issues. Every performance audit is grounded explicitly or implicitly in one or more theories of program evaluation. A deep understanding of alternative theories of program evaluation is helpful to gain clarity about sound auditing practices. We present a review of several theories of program evaluation.

This study includes a meta-evaluation of seven government audits on the efficiency and effectiveness of tourism departments and programs. The seven tourism-marketing performance audits are program evaluations for: Missouri, North Carolina, Tennessee, Minnesota, Australia, and two for Hawaii. The majority of these audits are negative performance assessments. Similarly, although these audits are more useful than none at all, the central conclusion of the meta-evaluation is that most of these audit reports are inadequate assessments. These audits are too limited in the issues examined; not sufficiently grounded in relevant evaluation theory and practice; and fail to include recommendations, that if implemented, would result in substantial increases in performance.

This study aims to develop an evaluation index to evaluate the economic value among the values of the library and also attempts to measure the economic value of the library by performing a survey of the librarians and users at public libraries. The results of this research would likely encourage the librarians to feel increasingly confident about the library, while students and users, in general, would also likely be able to realize the economic value and presence of the library in more perceptive ways, thereby contributing to the activation of the library.

This study pertains to the development of an evaluation index for assessing the economic value of the library and, to evaluate the economic value of the library, has derived a preliminary evaluation index by collectively gathering and analyzing the domestic and foreign papers on the value of the library in its first phase. The preliminary evaluation index derived was verified by conducting three phases of Delphi survey by selecting ten experts. The survey questionnaire was developed to measure the economic value based on the final evaluation index derived from this study, and the economic value was measured against the perceptions of librarians and users of the public library.

The economic value of the library was divided into the four categories of the local economy’s value enhancement, namely, connection with the local community, human resources development, job creation and investment value enhancement for the librarians and users surveyed for assessment purposes. Consequently, the area of connection with the local community turned out to be the highest at 4.15, followed by 4.02 of the investment value improvement, 3.58 for the local economy’s value improvement and 3.50 for the human resources development and job creation, respectively. Furthermore, the respondents demonstrated the highest level of consensus on average on how the resource sharing by libraries has helped to reduce the economic burden for the residents as a matter of social value for the public library while believing that the libraries deliver a high level of return on social investments.

There are not that many studies conducted on the economic influence or the value of public libraries in Korea, and they are merely referenced in part if and when referenced to the overall value of the library. Given that, the research that focuses only on the economic value of the library must be carried out. In this respect, this research has been quite meaningful. The evaluation index developed in this research is likely to become a basic tool that can be applied to public libraries, as well as other types of libraries. Furthermore, the evaluation index developed through this research could be applied to nonprofit organizations, such as libraries, and would likely have a social ripple effect as a research that evaluates and presents the economic value of libraries. Accordingly, in this research, we have analyzed the list presented by the American Library Association and domestic research results, and have also structured the core details and derived the preliminary economic value index. Finally, 4 evaluation areas, 7 evaluation items and 22 evaluation indicators have been developed through the Delphi survey through three phases.

The purpose of this paper is to investigate the effects of pre-existing mood valence, mood arousal and ad-evoked arousal on response to television and print advertising. It combined the arousal-as-information and arousal regulation approaches into a single arousal congruence theory. It sought an extended application of arousal congruence theory in the persuasion domain with several novel findings.

Four experiments were conducted to test the hypotheses. Analysis of variance, multivariate analysis of variance and pairwise comparison were used for data analysis.

Consumer judgment is a joint function of mood valence, mood arousal and ad-evoked arousal. Positive mood does not always generate more positive evaluations and vice versa. Ad-evoked arousal can more strongly influence consumers’ judgments when they are in a negative rather than a positive mood. Furthermore, consumers in a positive mood rate a target more favorably when the ad-evoked arousal level is congruent with their current arousal state, while those in a negative mood rate a target more favorably when the ad-evoked arousal level is incongruent with their current state of arousal. Arousal polarization intensifies such congruence (and incongruence) effects.

The findings reveal a mood-lifting opportunity based on ad-evoked arousal. This has implications for the design of advertisements, promotional materials, marketing campaigns and retailing environments.

This paper’s findings highlight unexpected effects of stimulus-evoked arousal in persuasion when consumers are exposed to multiple emotional cues from the environment. The paper demonstrates the utility of an integrated model, explaining the relative importance of valence and arousal in influencing consumer judgments. It has been the first to examine arousal congruence, arousal polarization and arousal regulation mechanisms jointly.

This paper aims to examine to what extent congruity between ethical attributes (i.e. product attributes with positive implications for the environment, human rights, social issues and animal welfare) and brand concept (i.e. the unique meaning associated with a brand in consumers’ minds) influences consumers’ evaluations of brands offering ethical attributes.

Four studies involving North American consumers empirically tested the moderation effect of brand concept on consumer evaluations of ethical attributes and the mediating role of perceived congruity.

This research finds an interactive effect of ethical attribute type and brand concept on brand evaluations, such that congruent ethical attribute–brand concept pairings (i.e. a utilitarian [symbolic] ethical attribute offered by a brand with a utilitarian [symbolic] brand concept) result in more favorable brand evaluations (Studies 1, 2, 3 and 4). Consumers’ perceptions of congruity between ethical attributes and brand concepts mediate this interactive effect (Studies 2 and 3). Moreover, a positive congruity effect of ethical attributes and brand concepts emerges at higher levels of conspicuous brand consumption (Study 4).

It is important to acknowledge that the current research did not specifically consider the case of utilitarian and symbolic ethical attribute offerings by luxury brands. This is a question that is left to future investigations.

For marketing managers, findings indicate that brands gain from ethical attribute introductions only when these attributes are congruent with the brand concept. In addition, brands benefit to a greater extent from offering congruent ethical attributes when brand consumption is conspicuous.

The findings of this research contribute to the literature on the effect of ethical attributes on consumers’ responses to brands and highlight the importance of brands’ choice of ethical attributes.