Search results

1 – 10 of over 69000
Article
Publication date: 1 June 1997

James L. Price

Addresses the standardization of the measurements and the labels for concepts commonly used in the study of work organizations. As a reference handbook and research tool, seeks to…

16031

Abstract

Addresses the standardization of the measurements and the labels for concepts commonly used in the study of work organizations. As a reference handbook and research tool, seeks to improve measurement in the study of work organizations and to facilitate the teaching of introductory courses in this subject. Focuses solely on work organizations, that is, social systems in which members work for money. Defines measurement and distinguishes four levels: nominal, ordinal, interval and ratio. Selects specific measures on the basis of quality, diversity, simplicity and availability and evaluates each measure for its validity and reliability. Employs a set of 38 concepts ‐ ranging from “absenteeism” to “turnover” as the handbook’s frame of reference. Concludes by reviewing organizational measurement over the past 30 years and recommending future measurement reseach.

Details

International Journal of Manpower, vol. 18 no. 4/5/6
Type: Research Article
ISSN: 0143-7720

Keywords

Article
Publication date: 28 April 2020

Kyungyeol Anthony Kim, Senyung Lee and Kevin K Byon

The purpose of this study is to evaluate the psychometric properties of each item in the Sport Spectator Identification Scale (SSIS) (Wann and Branscombe, 1993) using the item…

Abstract

Purpose

The purpose of this study is to evaluate the psychometric properties of each item in the Sport Spectator Identification Scale (SSIS) (Wann and Branscombe, 1993) using the item response theory (IRT) and to provide evidence for modifications in the scale.

Design/methodology/approach

A total of 635 spectators of US professional sports responded to the seven-item SSIS on an eight-point semantic differential scale. The general partial credit model was fitted to the data.

Findings

The results revealed that four items (Items 1, 2, 3 and 5) provide a relatively high amount of information, whereas three items (Items 4, 6 and 7) provide a low amount of information, indicating different levels of measurement precision among the items. Furthermore, the results showed that some low-level response options were rarely selected by participants, indicating that it may not be necessary to include response options as many as eight within each item.

Originality/value

Unlike previous studies examining the psychometric properties of the SSIS as a whole, the present study provides information about the usefulness of each item of the SSIS in measuring individuals' team identification. Based on the findings, the authors identified some issues with the three problematic items, including the wording of the items and the link between the question and the target construct. The authors make several suggestions for researchers and practitioners in improving individual item quality and in making informed decisions when using the SSIS in the future.

Details

International Journal of Sports Marketing and Sponsorship, vol. 21 no. 4
Type: Research Article
ISSN: 1464-6668

Keywords

Article
Publication date: 8 May 2017

Carlo Caponecchia and Daniel S.J. Costa

The purpose of this paper is to examine aspects of how workplace bullying is identified by the Negative Acts Questionnaire-Revised (NAQ-R), with a focus on the appropriateness of…

Abstract

Purpose

The purpose of this paper is to examine aspects of how workplace bullying is identified by the Negative Acts Questionnaire-Revised (NAQ-R), with a focus on the appropriateness of its response scale using item response theory (IRT).

Design/methodology/approach

IRT, in which the probability of a particular item response reflects an underlying latent variable, was used to examine NAQ-R responses from a sample of 1,173 Australian public servants (Study 1), and a representative UK data set (n=3,494; Study 2).

Findings

Results indicated that problems with the response scale appear to be due to the inclusion of the abstract “now and then” option amongst concrete time options (“never”, “now and then”, “monthly”, “weekly” and “daily”). These results were replicated in Study 2, providing evidence of the robustness of the findings, and suggesting the observations are not sample specific.

Research limitations/implications

This work has implications for methods employed to identify and measure workplace bullying in research and organisational practice. Inconsistent endorsement of response scale options is a concern when total scores are calculated, or when a number of behaviours being experienced with a particular frequency on the response scale are taken as an indication of bullying having occurred.

Originality/value

Examining and refining the manner in which workplace bullying is indexed is important for identifying and managing workplace risks to health, safety and well-being.

Details

Journal of Managerial Psychology, vol. 32 no. 4
Type: Research Article
ISSN: 0268-3946

Keywords

Article
Publication date: 5 July 2023

Mateus Canniatti Ponchio, Mayank Jyotsna Soni, Mousumi Singha Mahapatra and Soumya Sarkar

This study aims to evaluate Netemeyer and colleagues' much cited financial well-being scale in Brazil and India and compare responses from different demographics. It also compares…

Abstract

Purpose

This study aims to evaluate Netemeyer and colleagues' much cited financial well-being scale in Brazil and India and compare responses from different demographics. It also compares the results using two analysis techniques, item response theory (IRT) and confirmatory factor analysis (CFA).

Design/methodology/approach

A total of 994 survey responses from Brazil and 1,081 from India were collected. IRT and CFA models were used to analyse the data.

Findings

The results demonstrate the two-dimensional structure of the financial well-being scale and show that different items are differentially useful in measuring the construct across different groups. These findings may support the scale's future refinement and use in applied studies that will target specific groups (e.g. males, females, younger respondents and older respondents).

Research limitations/implications

This study serves as an example to others who can explore the advantages of IRT over classical test theory methods to assess the psychometric properties of scales aimed at measuring latent constructs of interest in the field of marketing.

Practical implications

The correct diagnosis of financial well-being is important to guide interventions by governments and non-governmental entities, as well as by financial institutions interested in better understanding individuals.

Originality/value

The authors show how the identification of the characteristics of scale items provided by the IRT technique allows for a better understanding of its properties and how it can be improved.

Details

International Journal of Bank Marketing, vol. 41 no. 7
Type: Research Article
ISSN: 0265-2323

Keywords

Article
Publication date: 3 April 2018

Matthias von Davier

Surveys that include skill measures may suffer from additional sources of error compared to those containing questionnaires alone. Examples are distractions such as noise or…

Abstract

Purpose

Surveys that include skill measures may suffer from additional sources of error compared to those containing questionnaires alone. Examples are distractions such as noise or interruptions of testing sessions, as well as fatigue or lack of motivation to succeed. This paper aims to provide a review of statistical tools based on latent variable modeling approaches extended by explanatory variables that allow detection of survey errors in skill surveys.

Design/methodology/approach

This paper reviews psychometric methods for detecting sources of error in cognitive assessments and questionnaires. Aside from traditional item responses, new sources of data in computer-based assessment are available – timing data from the Programme for the International Assessment of Adult Competencies (PIAAC) and data from questionnaires – to help detect survey errors.

Findings

Some unexpected results are reported. Respondents who tend to use response sets have lower expected values on PIAAC literacy scales, even after controlling for scores on the skill-use scale that was used to derive the response tendency.

Originality/value

The use of new sources of data, such as timing and log-file or process data information, provides new avenues to detect response errors. It demonstrates that large data collections need to better utilize available information and that integration of assessment, modeling and substantive theory needs to be taken more seriously.

Details

Quality Assurance in Education, vol. 26 no. 2
Type: Research Article
ISSN: 0968-4883

Keywords

Open Access
Article
Publication date: 13 May 2019

Thomas Salzberger and Monika Koller

Psychometric analyses of self-administered questionnaire data tend to focus on items and instruments as a whole. The purpose of this paper is to investigate the functioning of the…

3020

Abstract

Purpose

Psychometric analyses of self-administered questionnaire data tend to focus on items and instruments as a whole. The purpose of this paper is to investigate the functioning of the response scale and its impact on measurement precision. In terms of the response scale direction, existing evidence is mixed and inconclusive.

Design/methodology/approach

Three experiments are conducted to examine the functioning of response scales of different direction, ranging from agree to disagree versus from disagree to agree. The response scale direction effect is exemplified by two different latent constructs by applying the Rasch model for measurement.

Findings

The agree-to-disagree format generally performs better than the disagree-to-agree variant with spatial proximity between the statement and the agree-pole of the scale appearing to drive the effect. The difference is essentially related to the unit of measurement.

Research limitations/implications

A careful investigation of the functioning of the response scale should be part of every psychometric assessment. The framework of Rasch measurement theory offers unique opportunities in this regard.

Practical implications

Besides content, validity and reliability, academics and practitioners utilising published measurement instruments are advised to consider any evidence on the response scale functioning that is available.

Originality/value

The study exemplifies the application of the Rasch model to assess measurement precision as a function of the design of the response scale. The methodology raises the awareness for the unit of measurement, which typically remains hidden.

Details

European Journal of Marketing, vol. 53 no. 5
Type: Research Article
ISSN: 0309-0566

Keywords

Article
Publication date: 17 August 2020

Jeovani Schmitt, Maria Inês Fini, Cyntia Bailer, Rosangela Fritsch and Dalton Francisco de Andrade

This study aims at developing an instrument to measure the latent trait propensity to drop out in face-to-face higher education.

Abstract

Purpose

This study aims at developing an instrument to measure the latent trait propensity to drop out in face-to-face higher education.

Design/methodology/approach

Based on Tinto's student integration theory, a 27-item scale was created to measure student propensity to drop out of undergraduate programs. Item response theory was used to evaluate the psychometric analysis of the items. Furthermore, different methodologies were used to evaluate and provide evidence for content validity, response process validity, internal structure validity and criterion-related validity.

Findings

With the support of specialists in the construct, the interpretation of the scores for the use of the scale was defined in four levels of propensity: high, moderate, low and very low.

Research limitations/implications

The latent trait propensity to drop out in face-to-face higher education allows the inclusion of new items and aspects in the instrument. Thus, it can be adapted to distance education.

Practical implications

The students' propensity to drop out score can be useful for researchers and administration units in colleges and universities in the planning of permanent institutional actions and programs to take preventive measures.

Social implications

Minimize dropout in order to raise the educational level of the population and make better use of the resources invested in education.

Originality/value

This study points out when, why and how propensity to drop out can be measured and how scores can be interpreted in the context of the problem.

Details

Journal of Applied Research in Higher Education, vol. 13 no. 2
Type: Research Article
ISSN: 2050-7003

Keywords

Article
Publication date: 22 May 2018

Richa Pandey and V. Mary Jessica

This study aims to investigate the behavioural biases influencing the real estate market investing decisions of normal non-professional investors in India.

1195

Abstract

Purpose

This study aims to investigate the behavioural biases influencing the real estate market investing decisions of normal non-professional investors in India.

Design/methodology/approach

As the study involves the behavioural data with polytomous response format, psychometric test- graded response model (IRT approach) was used for the study with the help of STATA 14. Multi-stage stratified sampling was used to collect a sample of 560 respondents. The study used a 14-item scale representing behavioural biases derived from two broad behavioural theories, i.e. heuristics and prospect theories. Sample characteristics were checked using SPSS 20. Pre-required assumptions for IRT (i.e. local independence and unidimensionality) were tested by CFA using AMOS 20.

Findings

Five items, four of which belong to heuristics (anchoring – 2, representativeness – 1 and availability bias – 1) and one belong to prospect theory (regret aversion) are sufficient to measure the behavioural attitude of real estate investors in the Indian scenario. Item discrimination ai ranged from 0.95 to 1.52 (average value 1.29), showing moderate discrimination power of the items. The items have done a pretty good job of assessing the lower level of agreement. For the higher level of agreement, the scale came out to be less precise, with less information and higher standard error of measurement.

Research limitations/implications

As the behavioural biases are often false, the study suggests the investors not to repeat these nasty biases to improve investment strategies. As they are shared and not easily changeable, understanding these biases may also help them in beating the market by acting as “noise traders”.

Practical implications

The traditional price index is incomplete in some essential respects. The inclusion of these behavioural biases into the construction of price index will greatly improve the traditional price index, policymakers should seriously think about it.

Social implications

Shelter is one of the basic needs; a dwelling unit is needed for one to stay in, develop and contribute to economy and society. If investors try to minimise these biases and policymakers keep a track of these while making strategies, mispricing in this sector can be controlled to some extent, which will ultimately help in the well-being of society.

Originality/value

This study contributes to the limited research by investigating the behavioural biases influencing the real estate market investment decisions of normal non-professional investors. It contributes to the lacking academe on real estate market in India. The study has used a psychometric test, i.e. the item response theory, for evaluating the quality of the items.

Details

International Journal of Housing Markets and Analysis, vol. 11 no. 4
Type: Research Article
ISSN: 1753-8270

Keywords

Article
Publication date: 16 August 2021

Yunsoo Lee, Ji Hoon Song and Soo Jung Kim

This paper aims to validate the Korean version of the decent work scale and examine the relationship between decent work and work engagement.

Abstract

Purpose

This paper aims to validate the Korean version of the decent work scale and examine the relationship between decent work and work engagement.

Design/methodology/approach

After completing translation and back translation, the authors surveyed 266 Korean employees from various organizations via network sampling. They assessed Rasch’s model based on item response theory. In addition, they used classical test theory to evaluate the decent work scale’s validity and reliability.

Findings

The authors found that the current version of the decent work scale has good validity, reliability and item difficulty, and decent work has a positive relationship with work engagement. However, based on item response theory, the assessment showed that three of the items are extremely similar to another item within the same dimension, implying that the items are unable to discriminate among individual traits.

Originality/value

This study validated the decent work scale in a Korean work environment using Rasch’s (1960) model from the perspective of item response theory.

Details

European Journal of Training and Development, vol. 47 no. 1/2
Type: Research Article
ISSN: 2046-9012

Keywords

Article
Publication date: 1 July 2006

Thomas Salzberger and Rudolf R. Sinkovics

The paper investigates the suitability of the Rasch model for establishing data equivalence. The results based on a real data set are contrasted with findings from standard…

2047

Abstract

Purpose

The paper investigates the suitability of the Rasch model for establishing data equivalence. The results based on a real data set are contrasted with findings from standard procedures based on CFA methods.

Design/methodology/approach

Sinkovics et al.'s data on technophobia was used and re‐evaluated using both classical test theory (CTT) (multiple‐group structural equations modelling) and Rasch measurement theory.

Findings

Data equivalence in particular and measurement in general cannot be addressed without reference to theory. While both procedures can be considered best practice approaches within their respective theoretical foundation of measurement, the Rasch model provides some theoretical virtues. Measurement derived from data that fit the Rasch model seems to be approximated by classical procedures reasonably well. However, the reverse is not necessarily true.

Practical implications

The more widespread application of Rasch models would lead to a stronger justification of measurement, in particular, in cross‐cultural studies but also whenever measures of individual respondents are of interest.

Originality/value

Measurement models outside the framework of CTT are still scarce exceptions in marketing research.

Details

International Marketing Review, vol. 23 no. 4
Type: Research Article
ISSN: 0265-1335

Keywords

1 – 10 of over 69000