Search results

The purpose of this paper is to present a novel synthetic index of two counts and mathematical model for researcher evaluation.

A synthetic index L for researcher evaluation considering both the total number of other citations (C) and nonacademic impact (I) and a synthetic evaluation model are proposed in this paper. C and I are verified impact indexes. According to investigation by Delphi method, researchers are divided into five different classes of “below average,” “average,” “good,” “excellent” and “stellar.” The threshold values for counts C of grey class “stellar” are determined by deep investigation. The possibility functions of the two counts C and I on four grey classes of “below average,” “average,” “good” and “excellent” are built.

The novel synthetic index of two counts and mathematical model for researcher evaluation provide a better way to conduct researcher assessment.

The synthetic index L presented in this paper can be used to evaluate a researcher. It's more reasonable than the current research assessment indexes such as the number of publications and the numbers of so-called high-quality journal publications and the amount of granted funds and so on. The synthetic index L reflects the actual value created by a researcher. No artificial maneuver can change them significantly.

A synthetic index L for researcher evaluation considering both the total number of other citations (C) and nonacademic impact (I) and a synthetic evaluation model are proposed in this paper.

This paper aims to propose a new qualitative indicator for the evaluation of the productions of researchers in any discipline.

Based on the study of existing quantitative indicators, the authors’ approach consisted of the hybridization of two indicators. This hybridization is based on the individual H_index (Hi_index) and H_index contemporary (Hc_index) weighted by qualitative factors. The initial sources of the data are online bibliographic databases, such as Google Scholar and Publish or Perish.

A new scientometric indicator was used to compare the scientific production quality of researchers and their classification (as part of a research community) as the classification of national and international research institutions. The authors have applied a new indicator to compare and classify the members of their laboratory, RIADI, according to their quality of scientific production.

The indicator is an improvement of the H_index. It is a measure that can have an impact on society (influencing research attitudes, affecting quality of research). By this contribution, the authors measure more than one aspect by involving all the external factors that can affect the quality of research.

This paper fulfils a gap in the literature concerning the absence of a qualitative indicator among the set of existing quantitative measures. Additionally, this paper addresses the limitations of the existing qualitative practices, such as peer review and citation analysis. In the new qualitative indicator, the authors involve all of these qualitative aspects: the influence of the age of the paper, the number of co-authors, the order of the co-authors, the impact factor of journals and the conference rankings.

The purpose of this research is to document the development and evaluation of a multimedia resource for the principles, techniques and syllabus content for Rough and Tumble (RAT) – a South African martial art.

The researcher uses the Eclectic‐Mixed Methods‐Pragmatic Paradigm (EMMPP) as the theoretical framework. Development research provides the basis for varied research methods and instruments, which tie into the practical and complex nature of the EMMPP. The researcher uses both a quantitative and qualitative approach, but the study is mostly qualitative in nature, due to the small numbers of participants. Data and findings are triangulated with a wide variety of methods, instruments and participants. Methods include expert reviews, observation, records, and learner feedback.

Experts, learners and users report favourably on the usefulness, usability, functionality, appeal, and effectiveness of the RAT CD‐ROM as a learning and reference resource. Observation (cognitive walkthrough) reveals that inexperienced users experienced problems with navigation.

This study is limited by its small numbers of participants, making it difficult to conduct useful quantitative analysis. As the project matures the researcher is creating a version of the RAT CD‐ROM on the WWW, which requires further evaluation.

This research is useful in the domain of online learning, as it shows that support for kinaesthetic kinds of learning can occur in computer mediated environments.

This study is not the only work being done on martial arts learning on the WWW, but it is unique in that the researcher has created complex learning environments that allow learners to create, contribute, and demonstrate new knowledge, skills and attitudes. The RAT CD‐ROM has value for learners and teachers of RAT, as they have useful, effective learning and reference resources. Other martial artists may benefit from the RAT CD‐ROM, as several other martial arts systems have been included on the RAT CD‐ROM.

As a consequence of changes in the steering of the public sector in Norway during the 1990s, evaluation has, as in other European countries, become a standard element in the governing of the sector. However, evaluation procedures also seem to be an important instrument in the implementation of public sector reforms in this country. Provides an “inside” report on how evaluation may function in this respect. By analysing the role evaluation played in the implementation of an educational reform in Norway, discusses to what extent this way of organising implementation processes represent a change in public sector steering.

The purpose of this paper is to focus on the analysis of the characteristics and gaps of a literature fragment from the international scientific publications on performance evaluation in lean production, aiming to generate new knowledge and suggestions for future scientific research.

The authors have adopted “ProKnow-C” methodology, a qualitative research approach that is used for literature selection, identification, analysis and reflection on the established characteristics.

From a bibliographic portfolio of 67 research works, 91 per cent of the works have individual metrics and 84 per cent have sets of metrics. Evaluating the focus of the performance measurement system, 34 per cent of works measure performance, 43 per cent compare performance and only 18 per cent assist in strategic planning. Evaluating the phases of the PMS life cycle, 87 per cent attend to the design, and 66 per cent attend to the activities of data collection, allow diagnosis, evaluate performance and communicate results. However, only 3 per cent of the studies analysed the use of PMS after its implementation and no research evidenced the review of metrics and objectives based on strategic planning.

The search formula to capture the bibliographic portfolio (BP) was limited to the following terms: performance measurement, performance evaluation, performance assess*, performance appraisal, management, indicator*, critical factors, best practices, lean production, lean manufacturing and lean system. The BP was determined based on the limitations set by the research authors: articles published in English and Portuguese languages, from 2000 to 2018, in the Engineering Village, Scopus, EBSCO, Web of Science, ProQuest and Science Direct databases, which were freely available on the internet. Lastly, conceptual knowledge was used to select the articles, so there is a chance that unintentional losses could happen.

As practical implications for practitioners, the authors have identified that a PMS from an organisation that aims to become “lean” needs to be defined and revised considering its strategy, adjusting its set of metrics and targets to the internal and external challenges. As practical implications for researchers, opportunities have been identified to develop longitudinal studies in PMS utilisation and review to understand how the measurement system must evolve over time through changes in the internal and external environments of organisations.

This research adds value because its results allow researchers and practitioners to visualise the boundaries of the knowledge from the BP, about performance management in lean production, and what their gaps are in relation to the reference model of performance evaluation. This research is original because it was not observed in the literature review, a research that used the ProKnow-C methodology for analysis of the alignment and gaps between lean production and performance evaluation.

The aim of this study is to highlight how responses to student evaluation of a European Commission-funded multi-disciplinary summer course for international PhD students can be used to demonstrate a range of potential outcomes for individual researchers. It details the mixed-methods approach taken to evaluation of this course and shows how the results of this can be used to inform, validate and strengthen future provision of intensive training of this nature for PhD researchers.

The two-week LEADER course held in Edinburgh in July 2013 is used as a case study for the use of a mixed-methods evaluation approach to measuring potential impact. The Vitae Impact Framework is used as a tool to map three different evaluation methods and responses to impact levels. Further analysis of evaluation responses gives insight into rates of participant satisfaction, learning attributed to the course and behavioural changes made as a result of the experience.

The results of this study demonstrate the potential value of intensive, multi-disciplinary courses in providing lasting benefits to researchers both in personal and professional contexts.

The timeframe of this study spans a total of seven months. Although initial findings demonstrate clear short-term positive effects of the course on researchers, a longitudinal tracking study over several years would be required to assess longer term impact.

These findings can be used to inform and strengthen researcher development activities of this nature at other institutions.

Calls for the development and dissemination of evidence-based programs to support children and families have been increasing for decades, but progress has been slow. This paper aims to argue that a singular focus on evaluation has limited the ways in which science and research is incorporated into program development, and advocate instead for the use of a new concept, “scientific accompaniment,” to expand and guide program development and testing.

A heuristic is provided to guide research–practice teams in assessing the program’s developmental stage and level of evidence.

In an idealized pathway, scientific accompaniment begins early in program development, with ongoing input from both practitioners and researchers, resulting in programs that are both effective and scalable. The heuristic also provides guidance for how to “catch up” on evidence when program development and science utilization are out of sync.

While implementation models provide ideas on improving the use of evidence-based practices, social service programs suffer from a significant lack of research and evaluation. Evaluation resources are typically not used by social service program developers and collaboration with researchers happens late in program development, if at all. There are few resources or models that encourage and guide the use of science and evaluation across program development.

This paper aims to explore the possibilities in using such national, statutory data sets for evaluating change and the challenges of understanding service patterns and outcomes in complex cases when only a limited view can be gained using existing data. The discussion also explores how methodologies can adapt to an evaluation in these circumstances.

This paper examines the use of data routinely collected by local authorities (LAs) as part of the evaluation of innovation. Issues entailed are discussed and illustrated through two case studies of evaluations conducted by the research team within the context of children’s social care in England.

The quantitative analysis of LA data can play an important role in evaluating innovation but researchers will need to address challenges related to: selection of a suitable methodology; identifying appropriate comparator data; accessing data and assessing its quality; and sustaining and increasing the value of analytic work beyond the end of the research. Examples are provided of how the two case studies experienced and addressed these challenges.

• Quasi-experimental methods can be beneficial tools for understanding the impact of innovation in children’s services, but researchers should also consider the complexity of children’s social care and the use of mixed and appropriate methods. • Those funding innovative practice should consider the additional burden on those working with data and the related data infrastructure if wishing to document and analyse innovation in a robust way. • Data, which may be assumed to be uniform may in fact not be when considered at a multi-area or national level, and further study of the data recording practice of social care professionals is required.

The paper discusses some common issues experienced in quasi-experimental approaches to the quantitative evaluation of children’s services, which have, until recently, been rarely used in the sector. There are important considerations, which are of relevance to researchers, service leads in children’s social care, data and performance leads and funders of innovation.

Although many interventional approaches have been proposed to address the apparent gap between novices and experts for literature review (LR) search tasks, there have been very few approaches proposed for manuscript preparation (MP) related tasks. The purpose of this paper is to describe a task and an incumbent technique for shortlisting important and unique papers from the reading list (RL) of researchers, meant for citation in a manuscript.

A user evaluation study was conducted on the prototype system which was built for supporting the shortlisting papers (SP) task along with two other LR search tasks. A total of 119 researchers who had experience in authoring research papers participated in this study. An online questionnaire was provided to the participants for evaluating the task. Both quantitative and qualitative analyses were performed on the collected evaluation data.

Graduate research students prefer this task more than research and academic staff. The evaluation measures relevance, usefulness and certainty were identified as predictors for the output quality measure “good list”. The shortlisting feature and information cues were the preferred aspects while limited data set and rote steps in the study were ascertained as critical aspects from the qualitative feedback of the participants.

Findings point out that researchers are clearly interested in this novel task of SP from the final RL prepared during LR. This has implications for digital library, academic databases and reference management software where this task can be included to benefit researchers at the manuscript preparatory stage of the research lifecycle.

Challenges facing researcher development are explored in relation to three UK case study initiatives of building research capacity in Education. Drawing evidence from evaluations of these initiatives, we argue that expansive research workplaces build research capacity particularly effectively. The nature of expansiveness is dependent upon the range of learning opportunities, engagement with research communities and interpersonal support. The importance of inter‐institutional collaboration to promote capacity across the academic discipline is also highlighted. We conclude that the development of, engagement with, and investment in inter‐institutional, interproject communities is imperative to the effective building of research capacity.