Search results

Scholars often aim to conduct high quality research and their success is judged primarily by peer reviewers. Research quality is difficult for either group to identify, however and misunderstandings can reduce the efficiency of the scientific enterprise. In response, we use a novel term association strategy to seek quantitative evidence of aspects of research that are associated with high or low quality.

We extracted the words and 2–5-word phrases most strongly associated with different quality scores in each of 34 Units of Assessment (UoAs) in the Research Excellence Framework (REF) 2021. We extracted the terms from 122,331 journal articles 2014–2020 with individual REF2021 quality scores.

The terms associating with high- or low-quality scores vary between fields but relate to writing styles, methods and topics. We show that the first-person writing style strongly associates with higher quality research in many areas because it is the norm for a set of large prestigious journals. We found methods and topics that associate with both high- and low-quality scores. Worryingly, terms associated with educational and qualitative research attract lower quality scores in multiple areas. REF experts may rarely give high scores to qualitative or educational research because the authors tend to be less competent, because it is harder to do world leading research with these themes, or because they do not value them.

This is the first investigation of journal article terms associating with research quality.

To assess whether interdisciplinary research evaluation scores vary between fields.

The authors investigate whether published refereed journal articles were scored differently by expert assessors (two per output, agreeing a score and norm referencing) from multiple subject-based Units of Assessment (UoAs) in the REF2021 UK national research assessment exercise. The primary raw data was 8,015 journal articles published 2014–2020 and evaluated by multiple UoAs, and the agreement rates were compared to the estimated agreement rates for articles multiply-evaluated within a single UoA.

The authors estimated a 53% agreement rate on a four-point quality scale between UoAs for the same article and a within-UoA agreement rate of 70%. This suggests that quality scores vary more between fields than within fields for interdisciplinary research. There were also some hierarchies between fields, in the sense of UoAs that tended to give higher scores for the same article than others.

The results apply to one country and type of research evaluation. The agreement rate percentage estimates are both based on untested assumptions about the extent of cross-checking scores for the same articles in the REF, so the inferences about the agreement rates are tenuous.

The results underline the importance of choosing relevant fields for any type of research evaluation.

This is the first evaluation of the extent to which a careful peer-review exercise generates different scores for the same articles between disciplines.

The purpose of this paper is to develop an understanding for the social inclusion of disabled performers in a developing country to create awareness and improve policies/practices.

The study employed qualitative methodology, and data were collected through semi-structured interviews, site visits/observations and review of secondary data.

The data from different respondent groups showed the social inclusion should be reviewed at three levels: the state, society and individual. The review of existing policies revealed the neglect of the state regarding disabled people in general and even more so in performing arts due to the lack of enforcement of national and international agreements. Findings indicate that social inclusion of disabled performers is a minor issue, especially in a developing country where access to basic human rights and needs may be difficult. Amidst such difficulties, performing arts is not seen as a priority compared to other needs of disabled people and performers.

Limitations include the limited number of disabled performers who could be identified and were willing to participate in the study. Those working in venues/public offices were also reluctant to participate. The greatest limitation was the broad lack of interest in disabled performers.

In Türkiye, studies on disabled people tend to focus on basic needs like health, education and employment. None, to best of researchers' knowledge, explore the social inclusion of disabled performers. This is an original study because it collects and discusses primary data on this topic, revealing the state-level negligence/oversight, the apathy of society and the degree to which an individual with disabilities must struggle to participate in performing arts. Consequently, this study shows the difficulty of developing social inclusion, equality and diversity in an emerging economy for disabled performers to raise awareness and present grounds for further legal enforcement. Moreover, implications allow for a global understanding of social inclusion that moves beyond a biased or privileged understanding/critique of disability centered on the developed world.