Search results
1 – 10 of 563Thomas Salzberger and Rudolf R. Sinkovics
The paper investigates the suitability of the Rasch model for establishing data equivalence. The results based on a real data set are contrasted with findings from standard…
Abstract
Purpose
The paper investigates the suitability of the Rasch model for establishing data equivalence. The results based on a real data set are contrasted with findings from standard procedures based on CFA methods.
Design/methodology/approach
Sinkovics et al.'s data on technophobia was used and re‐evaluated using both classical test theory (CTT) (multiple‐group structural equations modelling) and Rasch measurement theory.
Findings
Data equivalence in particular and measurement in general cannot be addressed without reference to theory. While both procedures can be considered best practice approaches within their respective theoretical foundation of measurement, the Rasch model provides some theoretical virtues. Measurement derived from data that fit the Rasch model seems to be approximated by classical procedures reasonably well. However, the reverse is not necessarily true.
Practical implications
The more widespread application of Rasch models would lead to a stronger justification of measurement, in particular, in cross‐cultural studies but also whenever measures of individual respondents are of interest.
Originality/value
Measurement models outside the framework of CTT are still scarce exceptions in marketing research.
Details
Keywords
Thomas Salzberger, Hartmut H. Holzmüller and Anne Souchon
Measures are comparable if and only if measurement equivalence has been demonstrated. Although comparability and equivalence of measures are sometimes used interchangeably, we…
Abstract
Measures are comparable if and only if measurement equivalence has been demonstrated. Although comparability and equivalence of measures are sometimes used interchangeably, we advocate a subtle but important difference in meaning. Comparability implies that measures from one group can be compared with measures from another group. It is a property of the measures, which is given or not. In particular, comparability presumes valid measures within each group compared. Measurement equivalence, by contrast, refers to the way measures are derived and estimated. It is intrinsically tied to the underlying theory of measurement. Thus, measurement equivalence cannot be dealt with in isolation. Its assessment has to be incorporated into the theoretical framework of measurement. Measurement equivalence is closely connected to construct validity for it refers to the way manifest indicators are related to the latent variable, within a particular culture and across different cultures. From this it follows that equivalence cannot, or should not, be treated as a separate issue but as a constitutive element of validity. A discussion of measurement equivalence without addressing validity would be incomplete.
Han Soo Kim, Minsoo Kang and Minjung Kim
The purpose of this study is to evaluate the category function of the sport fandom questionnaire (SFQ), determine the optimal categorization of the SFQ and calibrate the…
Abstract
Purpose
The purpose of this study is to evaluate the category function of the sport fandom questionnaire (SFQ), determine the optimal categorization of the SFQ and calibrate the measurement qualities of the newly modified rating scale option using Rasch analysis.
Design/methodology/approach
This paper relies on the Rasch analysis to validate the SFQ. A series of studies are performed based on analysis procedures for the responses from 244 (study 1) and 477 (study 2) participants.
Findings
The results revealed that the original SFQ consisting of the eight-category rating scale is flagged due to irregular observation distribution and disordering of thresholds, whereas both six-category and seven-category rating scales meet the guidelines for the optimal categorization. However, only the seven-category rating scale showed desirable model-data fit indices. Furthermore, the results of the Rasch calibration model showed that all items of the SFQ have large variability, and a person's ability level varied moderately along the continuum.
Originality/value
Unlike previous studies, examining the psychometric properties of the SFQ, the current study provides information about the optimal categorization and presents a novel reconstruction category in measuring individuals' sport fandom level. In measuring the level of sport fandom, the authors suggest the use of a seven-category rating scale that the current study found to exhibit reliability and construct validity.
Details
Keywords
Joseph Chow, Ada Tse and Christine Armatas
The purpose of this paper is to report undergraduate students’ learning gains in six areas of generic skills. The paper reports on students’ responses to the First Year Experience…
Abstract
Purpose
The purpose of this paper is to report undergraduate students’ learning gains in six areas of generic skills. The paper reports on students’ responses to the First Year Experience (FYE) Survey completed at the end of their first year and Graduating Student Survey (GSS) in the final semester of their final year.
Design/methodology/approach
In this study, a longitudinal design was applied in data collection, analysis and reporting of assessment if student learning gains. The undergraduate students who were the first cohort of four-year curriculum students in a Hong Kong university were selected as the sample. Repeated measures of reported learning gains of a longitudinal sample based on stacking of both FYE and GSS data were analysed using the Rasch model.
Findings
The results showed that the scale for measuring the six areas of generic skills had high reliability and good person separation. Comparison of repeated measures from the same group of students at the two time points were examined to explore whether there is growth in the generic skills during their university studies.
Research limitations/implications
One limitation of the study was the relatively small sample size of 359 students in one higher education institution.
Practical implications
The findings of the study provide insight into conceptual understanding and measurement of university student learning gains.
Originality/value
Whilst several studies have investigated university student learning gains, there is limited research which explores the use Rasch modelling in assessment of student learning gains in multiple areas towards completion of their undergraduate studies.
Details
Keywords
The purpose of this paper is to develop a mobile social networking service (SNS) addiction scale to measure respondents’ addiction levels.
Abstract
Purpose
The purpose of this paper is to develop a mobile social networking service (SNS) addiction scale to measure respondents’ addiction levels.
Design/methodology/approach
Drawing on the existing literature on the components model of addiction by Griffiths (2005) and mobile SNS addiction, an initial scale in a five-point Likert-format was developed. It was refined through the pilot study with 100 participants and the main study with 423 participants utilizing factor analysis and Rasch analysis.
Findings
Mobile SNS addiction as a behavioral addiction, demonstrated six addiction symptoms: modification, salience, tolerance, withdrawal, conflict and relapse, which were interrelated with each other. The mobile SNS addiction scale developed in this study was found to be psychometrically robust and unidimensional.
Practical implications
The mobile SNS addiction scale consists of nine items, thus making it easier and more convenient to be applied to academic research and clinical practice.
Originality/value
The combined use of factor analysis and the Rasch model could largely reduce potential negative effects associated with limitations of classical test theory and improve the chance of developing a psychometrically robust instrument. The mobile SNS addiction scale covers a range of types of SNSs, thus being more generic. The items in the scale are unidimensionally loaded on the latent construct of mobile SNS addiction and demonstrate measurement invariance across respondents of different demographics.
Details
Keywords
Budi Setiawan, Umi Muawanah, Addin Maulana, Fauziah Khoiriyani, Marhanani Tri Astuti and Imam Nur Hakim
This study aims to analyze the capacity of ecotourists to exhibit behavior that aligns with the ecotourist scale using the Rasch model measurement.
Abstract
Purpose
This study aims to analyze the capacity of ecotourists to exhibit behavior that aligns with the ecotourist scale using the Rasch model measurement.
Design/methodology/approach
The data was gathered using an online survey incorporating the five tenets of ecotourism using a seven-point rating scale on domestic tourists in Indonesia. Descriptive statistics, cross-tabulation and Rasch model measurement were used to analyze the data.
Findings
The ecotourist identification scale measurement items were reliable and satisfactory. The most challenging behavior for ecotourists was using the services of a tour guide who was concerned about the environment. Meanwhile, respecting cultural differences around the tourist destination was the most accessible behavior. Most respondents demonstrated a fit response pattern and satisfactorily met the validity and reliability criteria.
Research limitations/implications
This study did not compare ecotourists’ ability to behave by the type of conservation visited as its limitation. However, it provides a significant methodological contribution to developing a measurement of ecotourist behavior implemented in well-established behavioral theories.
Practical implications
Integrating ecotourism into education, incentivizing eco-friendly tourism practices, promoting awareness, supporting local businesses, respecting local values and ensuring safe travels.
Originality/value
To the best of the authors’ knowledge, this study is the first of its kind to be conducted in Indonesia. It uses a unique and innovative method to reveal the unobserved variables in ecotourists’ behavior. The findings confirm that tourists’ behaviors align with the five tenets of ecotourism.
Details
Keywords
David V. Day and Matthew F. Barney
This chapter presents Infosys’ approach to leader development that includes the practical benefits of psychometric and statistical methods commonly used by other disciplines, such…
Abstract
This chapter presents Infosys’ approach to leader development that includes the practical benefits of psychometric and statistical methods commonly used by other disciplines, such as Rasch measurement and latent growth modeling. Infosys is beginning to use these with other individualized leader development practices such as coaching, intervention bundling, and evaluation. When combined, these elements have the potential to personalize developmental processes to each leader and improve microlevel leadership theory with the overarching purpose of enhancing global leadership at Infosys and promoting the science of individual leader development.
Jaehong Joo, Yunsoo Lee and Ji Hoon Song
Given that knowledge hiding hampers the management of employee knowledge, it is important to measure the phenomena before applying the intervention to alleviate it. This paper…
Abstract
Purpose
Given that knowledge hiding hampers the management of employee knowledge, it is important to measure the phenomena before applying the intervention to alleviate it. This paper aims to validate knowledge hiding measurements in South Korea.
Design/methodology/approach
The research collected 420 and 415 different Korean employee samples for each study, and they responded to their quality of knowledge hiding. The research conducted factor analysis using Mplus software and the Rasch model using JMetrik software based on the item response theory.
Findings
The research validated Korean versions of knowledge hiding measurements consisting of three factors and ten items. The study also found that knowledge hiding has a negative relationship with knowledge sharing and an unexpectedly positive relationship with team creativity. The study confirmed that the modified measurement yields acceptable discriminant and convergent validity.
Research limitations/implications
The research relied on self-reported data and may have an issue measuring their knowledge hiding generously. Therefore, researchers are encouraged to measure it from others, including supervisors and colleagues. This research has theoretical implications for psychometrically and systematically validating the measurement.
Practical implications
The research includes practical implications for contributing to Human resource development practitioners could assess employee traits accurately and manage their negative knowledge behavior.
Social implications
The research suggests the implications for detecting a positive relationship between knowledge hiding and team creativity. The study discussed that the specific climate could contribute to team creativity in Eastern contexts.
Originality/value
The research identified the importance of a psychometric validating process in the development of measurements.
Details
Keywords
Juan Ramón Oreja‐Rodríguez and Vanessa Yanes‐Estévez
This paper aims to propose a method for the longitudinal analysis of the environment considering both firms' and environmental variables.
Abstract
Purpose
This paper aims to propose a method for the longitudinal analysis of the environment considering both firms' and environmental variables.
Design/methodology/approach
The study is based on a sample of firms in Canary Islands (Spain) for 2000 and 2003. Managerial perceptions are considered, based on the cognitive perspective. The measurements used are the result of applying the Rasch model and the rack and stack analyses. This approach provides information about how dynamic the firms perceive the environment and also about how the items are perceived.
Findings
The results show that most firms perceive that dynamism increased between 2000 and 2003. From the perspective of the environmental variables, the most dynamic are perceived to be competition, demand, consumer motivation and technological resources.
Originality/value
This paper proposes a longitudinal method for environmental scanning that include both firms' and environmental variables. It considers managerial perceptions, that is the information entering the decision making process. It is one of the first papers to study environmental scanning with Rasch model and one of the few about longitudinal environmental analyses. It opens a field of research and applications of the Rasch model in the management literature.
Details
Keywords
Alireza Akbari and Mohsen Shahrokhi
The purpose of this research is to address the need for a robust system to accurately determine a cutoff score by using the Angoff method and leveraging the Rasch infit and outfit…
Abstract
Purpose
The purpose of this research is to address the need for a robust system to accurately determine a cutoff score by using the Angoff method and leveraging the Rasch infit and outfit statistics of item response theory by detecting and removing misfitting items in a test.
Design/methodology/approach
Researchers in educational evaluation support the use of grades as a complete measure to evaluate students’ overall academic performance. In higher education, determining cutoff scores is crucial for assessing academic progress and achievement. Higher education institutions worldwide set predefined minimal standards of success, sometimes referred to as cutoff thresholds. These thresholds serve as benchmarks for assessing performance quality and determining eligibility for academic credit or advancement.
Findings
The proposed approach combines the Angoff method with Rasch item fit statistics to precisely determine the cutoff score by excluding items that do not fit well (misfitting items) in a test. This methodology holds the potential to enhance the fairness and accuracy of grading practices, ensuring that assessments align with educational objectives and provide meaningful feedback to students.
Originality/value
The value of this research extends to various fields where cutoff scores are used for decision-making purposes. By using Rasch item fit statistics and the Angoff method, practitioners and researchers can enhance the quality and validity of their assessments.
Details