To read the full version of this content please select one of the options below:

Influence of prior acquaintance with the ratee on rater accuracy and halo

James R. Van Scotter (Louisiana State University, Baton Rouge, Louisiana, USA)
Karen Moustafa (Indiana University‐Purdue University Fort Wayne, Fort Wayne, Indiana, USA)
Jennifer R. Burnett (Bank of America, Jacksonville, Florida, USA)
Paul G. Michael (Pacific University, Hillsboro, Oregon, USA)

Journal of Management Development

ISSN: 0262-1711

Article publication date: 21 August 2007

Abstract

Purpose

The purpose of this paper is to examine the effect of acquaintance on performance rating accuracy and halo.

Design/methodology/approach

After expert ratings were obtained, US Air Force Officers (n=104) with an average of six years experience rated the performance of four officers who delivered 6‐7 minute briefings on their research projects; 26 raters reported being acquainted with one or more of the briefers. Raters were randomly assigned to use a rating format designed to encourage between‐ratee comparisons on each dimension or a format in which each ratee was separately rated on all dimensions.

Findings

Ratings made by acquainted raters were more accurate than ratings by unacquainted raters. Accuracy was positively correlated with halo for both sets of ratings. Rating format had no discernible effect on accuracy or halo.

Research limitations/implications

One limitation of this study is that the measure of acquaintance was not designed as a surrogate for familiarity. Development of a multi‐item, psychometrically‐valid measure of acquaintance should be the first step in pursuing this research. The use of a laboratory design where only a small percentage of the sample was acquainted with those being rated also limits the study's generalizability.

Practical implications

The results show that prior acquaintance with the ratee results in more accurate ratings. Ratings were also more positive when raters had prior contact with the person they rated.

Originality/value

The hypothesis is that the cognitive processes used to produce ratings are different for raters who have had no prior contact with a ratee and raters who are in some manner acquainted with a ratee. In the past, a positive halo effect from acquaintance between raters and ratees has been a concern. However, this limited study indicates that acquaintance may actually result in more accurate ratings.

Keywords

Citation

Van Scotter, J.R., Moustafa, K., Burnett, J.R. and Michael, P.G. (2007), "Influence of prior acquaintance with the ratee on rater accuracy and halo", Journal of Management Development, Vol. 26 No. 8, pp. 790-803. https://doi.org/10.1108/02621710710777282

Publisher

:

Emerald Group Publishing Limited

Copyright © 2007, Emerald Group Publishing Limited