Search results

1 – 10 of over 70000
Book part
Publication date: 12 June 2015

Samir Hachani

Peer review has been with humans for a long time. Its effective inception dates back to World War II resulting information overload, which imposed a quantitative and qualitative…

Abstract

Peer review has been with humans for a long time. Its effective inception dates back to World War II resulting information overload, which imposed a quantitative and qualitative screening of publications. Peer review was beset by a number of accusations and critics largely from the biases and subjective aspects of the process including the secrecy in which the processes became standard. Advent of the Internet in the early 1990s provided a manner to open peer review up to make it more transparent, less iniquitous, and more objective. This chapter investigates whether this openness led to a more objective manner of judging scientific publications. Three sites are examined: Electronic Transactions on Artificial Intelligence (ETAI), Atmospheric Chemistry and Physics (ACP), and Faculty of 1000 (F1000). These sites practice open peer review wherein reviewers and authors and their reviews and rebuttals are available for all to see. The chapter examines the different steps taken to allow reviewers and authors to interact and how this allows for the entire community to participate. This new prepublication reviewing of papers has to some extent, alleviated the biases that were previously preponderant and, furthermore, seems to give positive results and feedback. Although recent, experiences seem to have elicited scientists’ acceptance because openness allows for a more objective and fair judgment of research and scholarship. Yet, it will undoubtedly lead to new questions which are examined in this chapter.

Details

Current Issues in Libraries, Information Science and Related Fields
Type: Book
ISBN: 978-1-78441-637-9

Keywords

Article
Publication date: 19 May 2023

Jie Meng

This paper aims to quantify the quality of peer reviews, evaluate them from different perspectives and develop a model to predict the review quality. In addition, this paper…

Abstract

Purpose

This paper aims to quantify the quality of peer reviews, evaluate them from different perspectives and develop a model to predict the review quality. In addition, this paper investigates effective features to distinguish the reviews' quality. 

Design/methodology/approach

First, a fine-grained data set including peer review data, citations and review conformity scores was constructed. Second, metrics were proposed to evaluate the quality of peer reviews from three aspects. Third, five categories of features were proposed in terms of reviews, submissions and responses using natural language processing (NLP) techniques. Finally, different machine learning models were applied to predict the review quality, and feature analysis was performed to understand effective features.

Findings

The analysis results revealed that reviewers become more conservative and the review quality becomes worse over time in terms of these indicators. Among the three models, random forest model achieves the best performance on all three tasks. Sentiment polarity, review length, response length and readability are important factors that distinguish peer reviews’ quality, which can help meta-reviewers value more worthy reviews when making final decisions.

Originality/value

This study provides a new perspective for assessing review quality. Another originality of the research lies in the proposal of a novelty task that predict review quality. To address this task, a novel model was proposed which incorporated various of feature sets, thereby deepening the understanding of peer reviews.

Details

The Electronic Library , vol. 41 no. 2/3
Type: Research Article
ISSN: 0264-0473

Keywords

Article
Publication date: 15 August 2016

Catherine Mangan, Mark Pietroni and Denise Porter

The purpose of this paper is to report on the use of an innovative peer review approach to identifying and addressing the causes of inappropriate admissions from hospital to…

Abstract

Purpose

The purpose of this paper is to report on the use of an innovative peer review approach to identifying and addressing the causes of inappropriate admissions from hospital to nursing homes in South Gloucestershire (SG). It explains the methodology that was developed, the findings of the peer review process and reflects on the effectiveness of the process.

Design/methodology/approach

The peer review consisted of two stages. The first stage involved a panel of local stakeholders carrying out an audit of a random selection of cases where people had been assessed as needing permanent nursing or residential care. From this four cases of inappropriate admissions were identified. Stage two involved an externally facilitated process with two peer challenge panels; one of local stakeholders and the other external experts. The two panels analysed the cases of inappropriate admissions, identified the system causes and suggested actions to tackle the issues which were fed back to an audience of local stakeholders.

Findings

The combination of case audit and peer review was successful in providing robust challenge to the processes in SG by identifying shortcomings in the system and suggesting actions to improve outcomes.

Research limitations/implications

The approach was taken in one Council area and therefore may not be replicable in another area.

Practical implications

The case study suggests that a peer review approach using both local and external peers, including providers, is an effective way to identify weaknesses in the health and social care processes. The insights offered by external peers and providers is helpful for councils in identifying where to focus resources and suggests that other areas should consider proactive adaptations to the peer review methodology that is offered as part of the LGA’s programme of sector-led improvement.

Social implications

The case study suggests that a peer review approach could have a positive impact on the quality of care and quality of life for older people who are admitted to hospital.

Originality/value

The case study offers an innovative and original use of the peer review approach in social care that can be shared with other councils and partners. The Southwest Improvement Board have identified it as of particular interest to other areas seeking to work with partners to identify and implement positive change.

Details

Journal of Integrated Care, vol. 24 no. 4
Type: Research Article
ISSN: 1476-9018

Keywords

Article
Publication date: 21 April 2022

Daryl Mahon

The purpose of this study is to conduct a systematic search of the literature as it pertains to interventions delivered by peers to refugees and asylum seekers during the…

Abstract

Purpose

The purpose of this study is to conduct a systematic search of the literature as it pertains to interventions delivered by peers to refugees and asylum seekers during the resettlement process.

Design/methodology/approach

A preferred reporting items for systematic reviews and meta-analysis-compliant scoping review based on Arskey and O’Malley’s (2006) five steps was used. Four databases, Scopus, Embase, Ebsco and ScienceDirect, were searched for peer-reviewed articles published in English from 2000 to 2021. Studies were included if they reported on interventions, outcomes or the training received by adult peers to support refugees and asylum seekers during the resettlement process. Of an initial 632 journal articles retrieved, 14 met the inclusion criteria for this review.

Findings

Most included studies were conducted in Western high-income countries, with the exception of one. Studies were heterogeneous in terms of the nationalities of peers and those receiving peer interventions, the outcomes reported on, the content of interventions and the methodologies used. Findings suggest that peer interventions seem to be effective in addressing many of the challenges faced by refugees and asylum seekers. Community integration, acculturation and reductions in psychological distress are some of the key benefits. When such interventions are co-produced in participatory research involving refugees, asylum seekers and the civil society organisations that support this population, they are naturally culturally responsive and can, therefore, address issues relative to different ethnic needs during the resettlement process.

Originality/value

To the best of the authors’ knowledge, this is the first scoping review to be conducted in this area and adds to what is a very limited body of research.

Details

Mental Health and Social Inclusion, vol. 26 no. 3
Type: Research Article
ISSN: 2042-8308

Keywords

Article
Publication date: 5 June 2017

Peter R. Whipp and Richard Pengelley

The “Colleague Review of Teaching” programme (CRT) aimed to enhance reviewees’ confidence to teach. The paper aims to discuss this issue.

Abstract

Purpose

The “Colleague Review of Teaching” programme (CRT) aimed to enhance reviewees’ confidence to teach. The paper aims to discuss this issue.

Design/methodology/approach

Case studies using mixed-method, interview and questionnaire, repeated measures intervention were employed whereby academics in an Australian university science faculty volunteered to participate in a multi-faceted teaching review programme. Underpinned by confidence and self-determination theory, the CRT included peer coach training, reviewee choice, and a strengths-based approach to peer reviewing and coaching colleagues.

Findings

The reviewees declared an enhanced confidence to teach, teaching skills and unit design knowledge in an environment that was supportive of psychological needs. The peer coaches reported the CRT to be a positive experience that should continue. The strengths-based approach to peer observation of teaching and peer coaching facilitated department collegiality and was positively received by all participants who completed the programme.

Research limitations/implications

The indifferent response to the CRT protocol completion reconfirms that peer review is a complex science and needs careful negotiation.

Practical implications

Review, peer coach and mentor training, review practice, choice protocols and the multi-faceted approach (pre-observation meeting, observations, written report and post-observation meeting) were positively received.

Originality/value

This paper provides rich insight into the experiences of a teaching review process.

Details

International Journal of Mentoring and Coaching in Education, vol. 6 no. 2
Type: Research Article
ISSN: 2046-6854

Keywords

Article
Publication date: 14 September 2015

Andy Tattersall

The purpose of this paper is twofold, first, to discuss the current and future issues around post-publication open peer review. Second, to highlight some of the main protagonists…

1361

Abstract

Purpose

The purpose of this paper is twofold, first, to discuss the current and future issues around post-publication open peer review. Second, to highlight some of the main protagonists and platforms that encourages open peer review, pre-and post-publication.

Design/methodology/approach

The first part of the paper aims to discuss the facilitators and barriers that will enable and prevent academics engaging with the new and established platforms of scholarly communication and review. These issues are covered with the intention of proposing further dialogue within the academic community that ultimately address researchers’ concerns, whilst continuing to nurture a progressive approach to scholarly communication and review. The paper will continue to look at the prominent open post-publication platforms and tools and discuss whether in the future it will become a standard model.

Findings

The paper identifies several problems, not exclusive to open peer review that could inhibit academics from being open with their reviews and comments of other’s research. Whilst identifies opportunities to be had by embracing a new era of academic openness.

Practical implications

The paper summarises key platforms and arguments for open peer review and will be of interest to researchers in different disciplines as well as the wider academic community wanting to know more about scholarly communications and measurement.

Originality/value

This paper looks at many of the new platforms that have been previously ignored and discusses issues relating to open peer review that have only been touched on in brief by other published research.

Details

Online Information Review, vol. 39 no. 5
Type: Research Article
ISSN: 1468-4527

Keywords

Article
Publication date: 3 December 2021

Sonja P. Brubacher, Martine B. Powell, Linda C. Steele and David Boud

Investigative interviewers assess their colleagues' interviews (‘peer review’) as a necessary part of their practice, and for their self-development. Yet, there is little guidance…

Abstract

Purpose

Investigative interviewers assess their colleagues' interviews (‘peer review’) as a necessary part of their practice, and for their self-development. Yet, there is little guidance around what the process involves and how they might do it. Research suggests that effective peer review is supported by using guidance material. The goal of the present work was to describe the use of such a guide by a group of professionals who regularly conduct investigative interviews with children, to share what was learned with other professionals seeking to create a formalized peer review process.

Design/methodology/approach

Sixty US child witness interviewers completed a guided peer review assessment of an anonymous interview, as an assignment at the conclusion of an 18-hour training program that focused on developing their interviewing skills. They consented to the use of their learning data in research, and the research was approved by the university's research ethics board. Peer reviews were coded for the extent to which they used the guide to support their evaluations, and the overall quality of the review to assess the utility of the guide in supporting them to conduct effective assessments.

Findings

In general, the guide and instructions for providing feedback were moderately effective in supporting the peer assessments, but results suggested specific training in how to deliver peer review would be useful.

Practical implications

Through this process, the authors identified components that would be helpful to further increase the efficacy of peer review.

Originality/value

The aim of this work was to spark a greater conversation among practitioners and academics about professionalizing the peer review process and aiding interviewers to develop peer review tools that would support their continued growth. The authors conclude with five key tips for professionals that stem from the experiences creating and evaluating the guide in combination with existing literature and three areas for future investigation.

Details

The Journal of Forensic Practice, vol. 24 no. 1
Type: Research Article
ISSN: 2050-8794

Keywords

Article
Publication date: 5 April 2011

Davide Nicolini, Jean Hartley, Annette Stansfield and Judith Hurcombe

This paper seeks to critically examine the principles, mechanisms, and critical success factors of developmental peer review as a way to promote reflection and change in…

3205

Abstract

Purpose

This paper seeks to critically examine the principles, mechanisms, and critical success factors of developmental peer review as a way to promote reflection and change in organizations.

Design/methodology/approach

This paper calls developmental peer review the structured, managed, and collaborative process whereby reputable others are invited into an organisation to provide feedback and offer guidance on organisational change and improvement. In the paper, the authors use the example of developmental peer review in UK local government both to foreground some of the distinctive aspects of the methodology and to identify some of its critical conditions of use.

Findings

The paper argues that this type of initiative often co‐exists with a more judgemental inspection‐oriented double. The institutional framework that surrounds developmental peer review makes it therefore both a powerful and delicate tool. There is a need in this initiative to maintain a dynamic balance to avoid either coercion or collusion in review.

Practical implications

In order to achieve its potential, peer review needs to be clearly framed and constructed as a developmental initiative. In the paper, a number of suggestions of how to do so are offered. If doubts exist on the nature of the exercise, it is likely that people will interpret it as a form of inspection and react defensively, reducing its capacity to trigger learning and transformation.

Originality/value

This paper advances knowledge and understanding about developmental peer review, by drawing on the relevant literature and also analysing a prevalent form of such review in current use in local government organizations in England and Wales.

Details

Journal of Organizational Change Management, vol. 24 no. 2
Type: Research Article
ISSN: 0953-4814

Keywords

Article
Publication date: 1 May 2005

Jacqueline A. Blackmore

To provide a best practice framework for peer review via teaching observation as a method of appraising teaching performance within UK higher education (HE) institutions.

6212

Abstract

Purpose

To provide a best practice framework for peer review via teaching observation as a method of appraising teaching performance within UK higher education (HE) institutions.

Design/methodology/approach

The paper uses secondary data analysis via the current literature on peer review and peer appraisal, as well as use of primary data obtained via the design, implementation and analysis of semi‐structured interviews with management and teaching staff within the Faculty of Business and Management Science within a fictitiously named Riverbank University.

Findings

Provides a best practice framework for peer review based on the literature, where the case study university benchmarks well against the framework and an insight into the perceptions of teaching staff on the scheme.

Research limitations/implications

The sample of 40 teaching staff was from only one faculty, in one university. Before generalising the findings it would be prudent to widen the research to include a larger sample from more universities across the HE sector in the UK.

Practical implications

The research has massive implications for the UK HE sector if peer review is to be used as a method of assessing teaching performance.

Originality/value

The paper is valuable as a guide to senior management wishing to implement a peer observation scheme within their own institution.

Details

International Journal of Educational Management, vol. 19 no. 3
Type: Research Article
ISSN: 0951-354X

Keywords

Article
Publication date: 12 March 2024

Emmanuel Mogaji

The purpose of this viewpoint is to spotlight the role of reviewers within the collaborative triad of academic publishing. It argues that the significance of reviewers is often…

Abstract

Purpose

The purpose of this viewpoint is to spotlight the role of reviewers within the collaborative triad of academic publishing. It argues that the significance of reviewers is often disregarded, leading to a gap in our understanding of the peer review process. This perspective emphasizes reviewers as unsung heroes in the publishing ecosystem, providing intentional and thought-provoking insights into the less-discussed yet impactful developments in the evolving peer review landscape.

Design/methodology/approach

Leveraging the author’s distinguished background as a recipient of the Journal of Service Marketing Outstanding Reviewer Award, this paper offers a personal reflection and synthesised viewpoints on the peer review process. Serving as a representative voice for reviewers, it provides insightful perspectives from the vantage point of a peer reviewer, diverging from conventional editorials and commentaries authored by editors.

Findings

Acknowledging the shrinking reviewer pool, this viewpoint suggests a mandatory “review for review” system alongside incentives like editorial positions, while considering financial rewards for reviewers. The rise of generative artificial intelligence (AI) in review prompts ethical concerns but offers solutions for handling diverse submissions and dealing with “Reviewer 2.” While embracing open review for its transparency, potential pitfalls surrounding article confidence and copyright require attention. Ultimately, this viewpoint advocates for a collaborative approach, valuing reviewers, exploring innovative solutions, navigating ethical dilemmas in the technological age and implementing transparent practices responsibly for the betterment of scholarly discourse.

Originality/value

This viewpoint highlights the invaluable contributions of reviewers, enriching the scholarly community and promoting intellectual growth.

Details

Journal of Services Marketing, vol. ahead-of-print no. ahead-of-print
Type: Research Article
ISSN: 0887-6045

Keywords

1 – 10 of over 70000