Search results

The purpose of this paper is to give an empirically‐based review of the strengths and weaknesses of situational judgment tests (SJTs).

The features, history, and development of SJTs are discussed. Next, a computerized search (from 1990‐2007) is conducted to retrieve empirical studies related to SJTs. The effectiveness of SJTs is discussed in terms of reliability, criterion‐related validity, incremental validity, construct‐related validity, utility, adverse impact, applicant perceptions, fakability, and susceptibility to practice and coaching effects.

Strengths of SJTs are that they show criterion‐related validity and incremental validity above cognitive ability and personality tests. SJTs have also less adverse impact towards minorities (especially if the cognitive loading of the SJT is low). Furthermore, applicant reactions towards SJTs are positive and SJTs enable to test large applicant groups at once (through the Internet). In terms of weaknesses, SJTs might be prone to faking, practice, and coaching effects. There is also debate about what constructs are measured by SJTs.

Five avenues for future research are discussed: construct‐related validity of SJTs, utility of SJTs vis‐à‐vis other predictors, impact of SJT features on validity and adverse impact, examination of alternative stimulus and response formats, and cross‐cultural transportability of SJTs.

Practitioners receive evidence‐based information about the features, development, and strengths and weaknesses of SJTs.

Apart from the USA, SJTs have not made strong inroads in selection practice in Europe and other parts of the world. This evidence‐based paper might highlight the value of SJTs.

This chapter provides a contemporary view of state-of-the science research and thinking done in the areas of selection and classification. It takes as a starting point the observation that the world of work is undergoing important changes that are likely to result in different occupational and organizational structures. In this context, we review recent research on criteria, especially models of job performance, followed by sections on predictors, including ability, personality, vocational interests, biodata, and situational judgment tests. The paper also discusses person-organization fit models, as alternatives or complements to the traditional person-job fit paradigm.

The purpose of this paper is to provide an empirical comparison of a high-fidelity managerial simulation, assessment center (AC) ratings, to that of a lower fidelity managerial simulation, a video situational judgment test (SJT) in the prediction of manager career success.

Archival data were collected from a large utility company. A measure of general mental ability (GMA), an SJT, and an AC were examined as predictors of career success as measured by increases in salary.

The AC and the video SJT used in this study appeared to assess different constructs, extending previous findings that ACs and written SJTs measure distinct constructs. Furthermore, the AC dimensions and the SJT remained valid predictors of salary over a six year span following the test administration. In addition, the AC explained significant incremental variance beyond GMA and SJTs in career success six years after the assessment.

The SJTs and AC used in this study are similar in psychological fidelity, yet the ACs remained a more valid predictor over time. The recommendation is that lower fidelity simulations should not be used as prerequisites for higher fidelity simulations.

The results lend general support to the value of high-fidelity instruments in predicting longitudinal success.

The paper offers a comparison of the validity of ACs and video SJTs.

Situational judgment tests (SJTs) are widely used in personnel selection but have not been empirically explored as methods of training design. The purpose of this paper is to evaluate SJT-based training as a workplace training design method which utilizes active learning and structured feedback to enhance learning of both procedural and declarative knowledge.

Volunteers (n=416) were randomly assigned to full-length lecture-based training or abbreviated lecture-based training followed by 15 minutes of SJT-based training. Knowledge of training content was assessed at pre-test and three weeks after training.

SJT-based trainees showed greater improvement on declarative and procedural knowledge than those in traditional training.

The results indicate that integrating the SJT methodology into training delivery may lead to greater mastery of declarative and procedural knowledge relative to exclusive use of lecture-based training methods.

Findings suggest that the relatively inexpensive, low-fidelity scenario-based training methodology the authors detail may increase retention of training material compared to more traditional training methods.

This is the first study to incorporate SJT methodology into the design of training content and to demonstrate that such content can produce greater retention of both declarative and procedural content.

In industrial‐organizational psychology, research and practice has focused on the use of situational judgment tests to predict managerial job performance. Although there is considerable controversy over what these tests actually measure, many have argued that they at least partially measure practical intelligence or “common sense.” Therefore the purpose of this article is to discuss situational judgment tests as assessments of common sense.

Reviewing the relevant industrial‐organizational psychology literature, this article considers the history and development of situational judgment tests as well as how the field has defined situational judgment. It also reviews the empirical and theoretical literature on their effectiveness for assessing managerial decision‐making competence.

Situational judgment tests have been found to be effective predictors of many organizational outcomes in a variety of job settings and positions. In particular, they have been found to incrementally predict future performance on‐the‐job beyond other typical predictors. Situational judgment tests are also relatively easy to administer and score and are often well received by managers and job applicants.

This article suggests situational judgment tests offer an efficient method of assessing common sense that can easily be adapted to many employment settings.

This chapter examines EI, presents a history of EI including the various models, and a discussion of the three streams approach to classifying EI literature. The author advocates for the efficacy of the Stream One Ability Model (SOAM) of EI citing previous authors and literature. The commonly used SOAM instruments are discussed in light of recent studies. The discussion turns to alternate tests of the SOAM of EI including Situational Judgment Tests (SJTs). Recommendations include an analysis of SOAM instruments, a new approach to measurement, and increased use of SJTs to capture the four-branch ability model of EI.

We examined a large multi-year undergraduate leadership development program (LDP) across seven universities and used an integrated framework of transformational leadership and situational judgment tests (SJTs) during a critical and formative period of leadership development. This study was the first to show a significant relationship between experience and transformational leadership style in students in an undergraduate LDP using SJTs and the multifactor leadership questionnaire (MLQ). The results showed that greater experience was positively related to increased transformational leadership style and that high overall decision scores were indicated in all groups of students with varying leadership styles and varying experience levels and decision abilities. The study findings and implications are discussed, along with recommendations for leadership educators to develop decision quality in LDPs.

This paper aims to review the latest management developments across the globe and pinpoint practical implications from cutting-edge research and case studies.

This briefing is prepared by an independent writer who adds their own impartial comments and places the articles in context.

Training and development is widely recognized as a critical factor in organizational success. It is thus normal for organizations to invest substantially in the quest to extract maximum value from the talent they have at their disposal. To this end, most firms will use an array of different learning techniques. However, wise operators will also be on the lookout for original approaches that could help give them an advantage over the competition. Perhaps, situational judgment tests (SJTs) might fit the bill in this respect. Evidence confirms that SJTs are proven for such as personnel selection and organizational psychology. In the context of training though, the methodology remains under-explored by comparison. This is despite their use as an assessment tool prior to training or afterwards.

The paper provides strategic insights and practical thinking that have influenced some of the world’s leading organizations.

The briefing saves busy executives and researchers hours of reading time by selecting only the very best, most pertinent information and presenting it in a condensed and easy-to-digest format.

Assessment gamification, which refers to the addition of game elements to existing assessments, is commonly implemented to improved applicant reactions to existing psychometric measures. This study aims to understand the effects of gamification on applicant reactions to and measurement quality of situational judgment tests.

In a 2 × 4 between-subjects experiment, this study randomly assigned 315 people to experience different versions of a gamified situational judgment test, crossing immersive game elements (text, audio, still pictures, video) with control game elements (high and low), measuring applicant reactions and assessing differences in convergent validity between conditions.

The use of immersive game elements improved perceptions of organizational technological sophistication, but no other reactions outcomes (test attitudes, procedural justice, organizational attractiveness). Convergent validity with cognitive ability was not affected by gamification.

This is the first study to experimentally examine applicant reactions and measurement quality to SJTs based upon the implementation of specific game elements. It demonstrates that small-scale efforts to gamify assessments are likely to lead to only small-scale gains. However, it also demonstrates that such modifications can be done without harming the measurement qualities of the test, making gamification a potentially useful marketing tool for assessment specialists. Thus, this study concludes that utility should be considered carefully and explicitly for any attempt to gamify assessment.