Search results

This paper aims to conduct a comprehensive analysis to evaluate the current situation of journals, examine the factors that influence their development, and establish an evaluation index system and model. The objective is to enhance the theory and methodologies used for journal evaluation and provide guidance for their positive development.

This study uses empirical data from economics journals to analyse their evaluation dimensions, methods, index system and evaluation framework. This study then assigns weights to journal data using single and combined evaluations in three dimensions: influence, communication and novelty. It calculates several evaluation metrics, including the explanation rate, information entropy value, difference coefficient and novelty degree. Finally, this study applies the concept of fuzzy mathematics to measure the final results.

The use of affiliation degree and fuzzy Borda number can synthesize ranking and score differences among evaluation methods. It combines internal objective information and improves model accuracy. The novelty of journal topics positively correlates with both the journal impact factor and social media mentions. In addition, journal communication power indicators compensate for the shortcomings of traditional citation analysis. Finally, the three-dimensional representative evaluation index serves as a reminder to academic journals to avoid the vortex of the Matthew effect.

This paper proposes a journal evaluation model comprising academic influence, communication power and novelty dimensions. It uses fuzzy Borda evaluation to address issues related to the weighing of single evaluation methods. This study also analyses the relationship of the three dimensions and offers insights for journal development in the new media era.

Although educators would likely agree that values and ethics are important in all disciplines, they have particular importance for practice-oriented fields. These applied professionals need to solve complex social problems that require the application of ethical standards and value perspectives. While the importance of value-engaged practice is known to the applied field, there is little research and conversation about how values can be integrated into teaching. This chapter synthesizes values-education approaches in various practice-based disciplines such as public administration (PA), program evaluation, social work, and public health. This chapter draws from empirical and theoretical works as well as the authors' experiences developing, participating in, and conducting values-based research on professionals and professional education.

Educators strive to develop and implement high impact educational experiences, which are critical to ensuring university courses and curricula serve as memorable and transferable learning experiences for students. It is not clear, however, which experiences are exceptional from a student perspective, or what kinds of illustrative examples exist in applied disciplines. In this chapter, we ground our discussion of high impact educational experiences in the field of program evaluation, contextualize it as organized at the University of Minnesota, describe three experiences that have been repeatedly described as impactful by students, and engage in a collective dialogue as teachers and learners.

This chapter explores the relevance of critical race theory (CRT) and queer theory to the relational aspects of program evaluation. Often conceptual binaries that undergird traditional evaluation theory and practice (e.g., internal versus external evaluation, subjective versus objective analysis, observation versus intervention, and insider versus outsider positionalities) adversely influence rigid social roles between evaluator and participant limit a study's effectiveness in supporting programs for equity in contemporary school districts. To illustrate this approach, an array of problems within a program evaluation of a district-wide ethnic studies reform initiative is presented. Approaches to these challenges rooted in tenets of CRT and queer theory illustrate how the district was able to clarify goals and develop an effective implementation plan that focused on effective ethnic studies curriculum and pedagogy.

To assess whether interdisciplinary research evaluation scores vary between fields.

The authors investigate whether published refereed journal articles were scored differently by expert assessors (two per output, agreeing a score and norm referencing) from multiple subject-based Units of Assessment (UoAs) in the REF2021 UK national research assessment exercise. The primary raw data was 8,015 journal articles published 2014–2020 and evaluated by multiple UoAs, and the agreement rates were compared to the estimated agreement rates for articles multiply-evaluated within a single UoA.

The authors estimated a 53% agreement rate on a four-point quality scale between UoAs for the same article and a within-UoA agreement rate of 70%. This suggests that quality scores vary more between fields than within fields for interdisciplinary research. There were also some hierarchies between fields, in the sense of UoAs that tended to give higher scores for the same article than others.

The results apply to one country and type of research evaluation. The agreement rate percentage estimates are both based on untested assumptions about the extent of cross-checking scores for the same articles in the REF, so the inferences about the agreement rates are tenuous.

The results underline the importance of choosing relevant fields for any type of research evaluation.

This is the first evaluation of the extent to which a careful peer-review exercise generates different scores for the same articles between disciplines.

This article explores the applicability of participatory action research (PAR) on two levels: on the one hand, as a participatory evaluation method for community engagement and community development; on the other hand, as a tool to link ex ante and ex-post evaluation that situated at various stages of the policy cycle.

Through a practice-based case study of the community engagement process of Valletta Design Cluster, this paper aims to illustrate how PAR can offer collaborative and continuous evaluation by facilitating social action through a practical, situative, context-bounded, responsive and transformative framework.

The study explores how PAR can contribute to cultural sustainability by linking community development with participatory evaluation, and it offers new perspectives on the applicability of PAR as a tool to link ex ante and ex-post evaluation, situated at various stages of the policy cycle.

Although based on a single case, the paper demonstrates that the method has the potential to be applied in various contexts, as it helps to foster local ownership and to develop future cultural strategies, thus providing a base for cultural sustainability.

The novelty of this study is to link evaluation – a majorly top-down and ex ante approach – with participatory planning. PAR-E offers a continuous participatory framework for the whole European Capitals of Culture (ECoC) cycle, as well as serving as a tool for empowerment and community development.

Establishing and developing digital science and education evaluation platforms (DSEEPs) have several practical implications for the development of China's science, technology and education. Identifying and analyzing the key factors influencing DSEEP user experience (UX) can improve the users' willingness to use the platform and effectively promote its sustainable development.

First, a literature survey, a five-element model of UX and semi-structured interviews were used in this study to develop a DSEEP UX-influencing factor model, which included five dimensions and 22 influencing factors. Second, the model validity was verified using questionnaire data. Finally, the key influencing factors were identified and analyzed using a fuzzy decision-making trial and evaluation laboratory (fuzzy-DEMATEL) method.

Fourteen influencing factors, including diverse information forms and comprehensive information content, are crucial for the DSEEP UX. Its optimization path is “‘Function Services’ → ‘Information Resources’ → ‘Interaction Design’ → ‘Interface Design’ and ‘Visual Design’.” In this regard, platform managers can take the following measures to optimize UX: strengthening functional services, improving information resources, enhancing the interactive experience and considering interface effects.

This study uses a combination of qualitative and quantitative research methods to determine the key influencing factors and optimization path of DSEEP UX. Optimization suggestions for UX are proposed from the perspective of platform managers, who provide an effective theoretical reference for innovating and developing a DSEEP.

The paper is a proof of concept (PoC) intervention study aimed for developing performance management (PM) practices in manufacturing small and medium-sized enterprises (SMEs) with the longer-term aim enabling the SMEs to improve their productivity. The intervention was designed and deployed by a collaborative quartet of academics, management consultants, accountancy firm and a commercial bank manager.

The paper firstly musters a set of initialising PM practices aligned to productivity improvement. These are utilised to design a knowledge transfer intervention for deployment with a set of manufacturing SMEs incorporating some associated productivity tools. The evaluation of the intervention utilised a case study approach founded on a logic model of the intervention to assess the development of the PM practices.

The intervention contributed to a partial development of the mustered practices and the productivity diagnostic based on the multi-factor productivity (MFP) abstraction and a data extraction protocol had the strongest impact. The study revealed the importance of the three interlaced factors: Depth of engagement, feedback opportunities and the intervention gradient (the increase of independent action from the participating SME's and the diminishment of the external intervention effort).

The case study is based on a limited number of individual SME's, and within just the manufacturing sector.

SME businesses will require a more sustained programme of interventions than this pilot to develop PM capability, and depth of engagement within the SME is critical. Professional stakeholders can be utilised in recruitment of firms for intervention programmes. Business can start developing PM capability prior to PMS implementation using the tools from this programme.

The productivity diagnostic tool, based on a synthesis of MFP and the performance pyramid, an array of potential initialising practices for PM capability and discovery of potential mechanisms for PM practice development.