Search results

The purpose of this study is to describe the development and psychometric properties of a novel game- and video-based assessment of social attributes. Despite their increasing adaption, little research is available on the suitability of games and video analytics for measuring noncognitive attributes in the selection context.

The authors describe three novel assessments and their psychometric properties in a sample of 1,300 participants: a game-based adaptation of an Emotion Recognition Task, a chatbot-based situational judgment test for emotion management and a video-based conscientiousness assessment.

The novel assessments show good to moderate convergent validity for Emotional Recognition (r = 0.42), Emotion Management (r = 0.39) and Conscientiousness (r = 0.21). The video-based assessment demonstrates preliminary predictive validity for self-reported work performance. Novel game-based assessments (GBAs) are perceived as better designed and more immersive than traditional questionnaires. Adverse impact analysis indicates small group differences by age, gender and ethnicity.

Predictive validity findings need to be replicated using objective measures of performance, such as performance ratings by supervisors and extended to the GBAs. Adverse impact should be evaluated using a real-life applicant pool and extended to additional groups.

Evidence for the psychometric validity of novel assessment formats supports their adoption in selection and recruitment. Improved user experience and shortened assessment times open up new areas of application.

This study gives first insights into psychometric properties of video- and game-based assessments of social attributes.

Sets out the various categories of psychometric assessment tools and explores how they might be used by the employment counsellor.

While international learning programs have received a great deal of attention and have been found to provide valuable learning experiences for participants interested in developing global leadership competencies (GLCs), they are resource-intensive and variably effective. This chapter examines the relatively unexplored use of assessment center (AC) methodology as a complementary avenue for developing students’ GLCs. Scholarly literature sources pertaining to GLCs and their development, experiential learning theory, and AC methodology are reviewed to develop a conceptual model and propositions related to participants’ learning in an AC designed to develop GLCs. An example is described of one university’s design and facilitation of an AC used to develop students’ GLCs. The role of AC methodology, along with international and other learning experiences for developing students’ GLCs, and recommendations for future research, are discussed.

This paper aims to evaluate the efficacy of the Connor–Davidson Resilience Scale 10 (CD-RISC 10) (Campbell-Sills and Stein, 2007) for use in public accounting settings.

The analyses include an examination of possible demographic differences in overall score, the scale’s factor structure, the invariance of its factor structure across gender and age groups, the scale’s reliability and its convergent and divergent validity.

There are significant gender and age group difference in scores, but a common univariate factor structure for the scale. The authors further find that a two-factor solution provides a superior fit to the data compared to the single factor structure used in the most prior research. Spearman–Brown reliability coefficients, item-total correlations and coefficient alphas each support the reliability of the items loading on the scale for the full sample, as well as for each of the above-referenced demographic subsamples.

Limitations are acknowledged related to the use of self-report measures, absence of test-retest score comparisons and convergent and divergent assessments limited to the heterotrait–homomethod approach.

The CD-RISC 10 is an expedient resilience measure, as it can be completed and scored in just a few minutes. Human resource administrators at public accounting firms can use it as an initial screening measure to identify staff who might benefit from resilience training. The paper adds to the appreciation of what not to do in the face of crisis by the government and those in charge of large accounting organizations.

The CD-RISC 10 can be used in research and clinical efforts to reduce voluntary turnover of audit staff and enhance the well-being of auditors in the workplace.

This study provides empirical evidence that the CD-RISC 10 is a valid and reliable measure for future assessments of auditor resilience levels.

The main aim of this paper is to describe the content, structure and preliminary evaluation of a new Good Lives sexual offender treatment group (SOTG) for male mentally disordered offenders.

As evaluation and work on the SOTG is necessarily ongoing, case study descriptions of each patient who attended the SOTG and of their progress throughout SOTG are described.

Overall, the case study progress reports suggest that mentally disordered male patients made some notable progress on SOTG despite their differential and complex needs. In particular, attention to each patient's life goals and motivators appeared to play a key role in promoting treatment engagement. Furthermore, patients with lower intelligence quotient and/or indirect pathways required additional support to understand the links between the Good Lives Model (GLM) and their own risk for sexual offending.

Further evaluations of SOTG groups, that incorporate higher numbers of participants and adequate control groups, are required before solid conclusions and generalisations can be made.

Practitioners should consider providing additional support to clients when implementing any future SOTGs for mentally disordered patients.

This is the first paper to outline and describe implementation of the GLM in the sexual offender treatment of mentally disordered male patients group format. As such, it will be of interest to any professionals involved in the facilitation of sexual offender treatment within this population.

The purpose of this study was to analyze importance of artificial intelligence (AI) in education and its emphasis on assessment and adversity quotient (AQ).

The study utilizes a systematic literature review of over 141 journal papers and psychometric tests to evaluate AQ. Thematic analysis of quantitative and qualitative studies explores domains of AI in education.

Results suggest that assessing the AQ of students with the help of AI techniques is necessary. Education is a vital tool to develop and improve natural intelligence, and this survey presents the discourse use of AI techniques and behavioral strategies in the education sector of the recent era. The study proposes a conceptual framework of AQ with the help of assessment style for higher education undergraduates.

Research on AQ evaluation in the Indian context is still emerging, presenting a potential avenue for future research. Investigating the relationship between AQ and academic performance among Indian students is a crucial area of research. This can provide insights into the role of AQ in academic motivation, persistence and success in different academic disciplines and levels of education. AQ evaluation offers valuable insights into how individuals deal with and overcome challenges. The findings of this study have implications for higher education institutions to prepare for future challenges and better equip students with necessary skills for success. The papers reviewed related to AI for education opens research opportunities in the field of psychometrics, educational assessment and the evaluation of AQ.

To do an empirical assessment of the psychometric properties of an instrument that captures the multi‐dimensional nature of satisfaction with service recovery (RECOVSAT) using data (post‐recovery satisfaction ratings) from customers who have actually complained to a service firm.

The methodology is a survey of bank clients who have lodged complaints with a retail bank.

The empirical results suggest that a refined and shorter version of RECOVSAT demonstrates excellent construct validity when used to measure the post‐recovery satisfaction of complaining customers.

RECOVSAT is a valid and reliable instrument that can and should be used by service managers to assess customer satisfaction with their service recovery efforts. Failure to ensure that complaining customers are satisfied with the firm's service recovery efforts, can only lead to serious problems, as the service firm will be letting the customer down for the second time.

Practitioners or service firms can use their customer complaint database to calculate satisfaction with service recovery scores (RECOVSAT scores) for different geographical regions, for different business units or different departments, even per individual employee. These scores can even be linked to remuneration or service level agreements.

First study to empirically assess the psychometric properties of an instrument that captures the multi‐dimensional nature of satisfaction with service recovery using data (post‐recovery satisfaction ratings) from customers who have actually complained to a service firm. Confirmed validity and reliability.

This paper systematically reviews the evidence of reliability and validity of scales available in studies that reported surveys of students to assess their perceived self-efficacy of information literacy (IL) skills.

Search in two subject and two general databases and scanning of titles, abstracts and full texts of documents have been carried out in this paper.

In total, 45 studies met the eligibility criteria. A large number of studies did not report any psychometric characteristics of data collection instruments they used. The selected studies provided information on 22 scales. The instruments were heterogeneous in number of items and type of scale options. The most used reliability measure was internal consistency (with high values of Cronbach’s alpha), and the most used validity was face/content validity by experts.

The culture of using good-quality scales needs to be promoted by IL practitioners, authors and journal editors.

This paper is the first review of its kind, which is useful for IL stakeholders.

The purpose of this paper is to attempt to assess the validity of an assessment centre (AC) designed for the promotional purposes of police officers, conducted in the Asian context.

The study included 128 police officers of whom criterion data was available for 49 officers. They all took part in an established AC.

The overall AC rating was significantly related to both overall training performance (r=0.58, p<0.01) and estimated leadership potential data (r=0.25, p<0.05), both collected two years subsequent to the promotion process. Analyses further supported the situational specificity of the AC design; with particular exercises and performance traits underlying the predictive value of the AC. It also showed the incremental validity of the AC methodology over and above personality measures.

The study supports the continual usage of the AC methodology across cultural contexts.

As far as we know this research has not been done in this part of the world.

The assessment of risk of recidivism in sexual offenders is fundamental to clinical practice. It is widely accepted that, compared with actuarial measures of risk, unaided clinical judgment has generally been found to be of low reliability. Consequently, the literature has shown a surge in actuarial measures. However, a major difficulty in assessing risk in sex offenders is the low base rate, leading to an increased likelihood of making a false positive predictive error. To overcome this, risk assessment studies are increasingly using the receiver operating characteristic (ROC), which displays the relationship between level of risk and decision choice. This note summarises the methodological issues in measuring predictive accuracy in assessing risk of re‐offending in sexual offenders, and identifies from the literature both static and dynamic risk factors associated with sexual offence recidivism.