Search results

Case study research has been applied across numerous fields and provides an established methodology for exploring and understanding various research contexts. This paper aims to aid in developing methodological rigor by investigating the approaches of establishing validity and reliability.

Based on a systematic review of relevant literature, this paper catalogs the use of validity and reliability measures within academic publications between 2008 and 2018. The review analyzes case study research across 15 peer-reviewed journals (total of 1,372 articles) and highlights the application of validity and reliability measures.

The evidence of the systematic literature review suggests that validity measures appear well established and widely reported within case study–based research articles. However, measures and test procedures related to research reliability appear underrepresented within analyzed articles.

As shown by the presented results, there is a need for more significant reporting of the procedures used related to research reliability. Toward this, the features of a robust case study protocol are defined and discussed.

The effect of dynamic capabilities on operational excellence and the moderating effect of environmental dynamism on the relationship between operational excellence and dynamic capabilities in the apparel industry in Sri Lanka were investigated while developing new psychometric scales to assess operational excellence and dynamic capacities constructs.

We followed the exploratory sequential research design with a mixed-method research approach, aligning with the pragmatic research philosophy. Thus, both qualitative and quantitative research methods were followed.

Dynamic capabilities positively affect operational excellence, and environmental dynamism moderates the relationship between operational excellence and dynamic capabilities in the apparel industry in Sri Lanka such that when a higher environmental dynamism exists, a weaker positive relationship exists between dynamic capabilities and operational excellence. The two main dimensions of the operational excellence construct are continuous improvement of sustainable operational performance and sustainable competitive advantages. It empirically confirmed that sensing, seizing and reconfiguring capabilities are the three main dimensions of the dynamic capabilities construct.

This study was limited to the apparel industry in Sri Lanka. This research phenomenon should be explored in other industrial sectors worldwide to generalize the findings. The practitioners in the apparel sector may improve the organizational dynamic capabilities to achieve operational excellence and keep a strong positive relationship between dynamic capabilities and operational excellence in a highly dynamic environment if they address out-of-family situations with out-of-the-box thinking.

We generated two new empirical findings: (1) dynamic capabilities positively affect operational excellence, and (2) environmental dynamism moderates the relationship between dynamic capabilities and operational excellence. Also, we introduced validated new scales for assessing operational excellence and dynamic capabilities.

The article aims to present the results of adapting the team boosting behaviors (TBB) scale to Polish cultural conditions and validating it.

The research methodology consisted of three steps. In the first step, I translated the TBB scale into Polish using a rigorous back-translation method. Next, to assess content validity, nine domain experts reviewed the initial version of the instrument for clarity and relevance. Finally, I applied the scale to a sample of 532 team members and underwent thorough psychometric testing to assess construct validity. I employed structural equation modeling (SEM) with the partial least squares (PLS) factor-based algorithm technique for confirmatory factor analysis to assess the scale’s reliability and validity.

After development, the Polish version of the TBB scale kept its three sub-scale structures. However, the validation process led to a slight reduction in the number of test items compared to the original scale.

The findings imply that the Polish version of the scale is a valid and reliable tool for assessing TBB. However, I recommend additional studies to confirm this instrument’s structure.

The results confirmed the reliability and relevance of the tool for measuring TBBs in Polish cultural conditions. The tool provides the basis for implementing further research with the TBB construct in Poland and internationally.

Although the fitness switching costs scale (FSCS) was shown to have sound psychometric properties, the length of the 54-item may impose burdens on survey participants and present methodological and analytic challenges for researchers and practitioners. Therefore, the present study shortened and validated two versions of the FSCS, namely the 33-item FSCS (FSCS-33) and the 11-item FSCS (FSCS-11).

In Study 1 (n = 411), the most useful items from the FSCS for the FSCS-33 and FSCS-11 were identified using item response theory (IRT). Study 2 (n = 391) and Study 3 (n = 400) assessed the psychometric properties of the FSCS-33 and FSCS-11, respectively, using partial least squares structural equation modeling.

The FSCS-33 and FSCS-11 demonstrated strong reliability and validity in assessing switching costs in fitness centers.

The psychometrically sound short-form scales provide researchers and practitioners with convenient and accurate means of measuring switching costs in fitness centers.

This study aims to gain insights into how students perceive online examination practices and evaluation, as well as identify the key factors that impact their intentions toward online exams.

This empirical study conducted in India utilized an online survey method between May 24 and June 14, 2022. The data were collected from 712 undergraduate and postgraduate students through a Google Docs questionnaire. Descriptive analysis, exploratory factor analysis (EFA), regression and reliability analysis were conducted to analyze the data.

There are many studies related to the adoption of online learning. However, there are limited studies that explore the adoption and acceptance of online examinations and evaluations. This paper intends to fill this gap and tries to highlight important factors influencing online examination usage by the students. Five important factors emerged in the study include “pedagogy, validity, reliability,” “practicality,” “security,” “facilitating condition” and “intention,” The study concludes that taking tests online is preferred for several reasons, including the perceived increased dependability of grades and the decreased cost, time and effort associated with taking exams.

This research explores students' perceptions of learning management systems (LMS)-based online exams and provides insights for students to better prepare and adapt. It assists policymakers in developing fair assessment policies and improving LMS platforms. The study contributes to the theoretical understanding of e-learning and calls for further research to enhance the effectiveness of online exams. It identifies gaps in existing literature and recommends larger sample sizes, broader representation, longitudinal data collection and conversational methods for future research.

This study shows increasing research on e-learning and online examinations, mostly using quantitative methods. The important variables for understanding students' perceptions of online exams are “pedagogy, validity, reliability,” “practicality,” “security,” “facilitating condition” and “intention.” Concerns raised include validity, fairness and security. Electronic exams are more suitable for formative evaluation, and validity, reliability, security and adaptability are key pillars for successful online testing.

Valid and reliable measurement is critical to the assessment and evaluation of health interventions. However, few scholars have examined the psychometric properties of “gold standard” measures in carceral settings, and no research has explored the reliability, validity and factor structure of the 26-item World Health Organization Quality of Life (WHOQOL) BREF among older adults incarcerated in prison, a large and growing population marked by substantial chronic and life-limiting illness. This study aims to examine the reliability, validity and factor structure of the WHOQOL-BREF.

Secondary data from a large-scale study with older adults (age 45+) incarcerated in a Midwestern state were used (N = 499). Floor and ceiling effects were examined, as was the reliability of the measure (Cronbach's alpha). The structural validity of a four-factor and second-order four-factor model of the WHOQOL-BREF was examined using confirmatory factor analysis. Model data fit was examined using chi-square, standardized root mean square residual, comparative fit indices, Akaike information criterion and the Bayesian Information Criterion. Pearson product-moment correlation coefficients were also used to assess validity.

Results indicate adequate construct validity and reliability for the WHOQOL-BREF using the current sample. Model-data fit indexes also reveal adequate structure of the measure relative to other older adult samples. Non-random data and item exclusion are noteworthy limits, and future researchers are encouraged to co-conceptualize and operationalize life quality with older adults who are incarcerated.

To the best of the authors’ knowledge, this is the first study to explore the psychometric properties of the WHOQOL-BREF among older adults incarcerated in prison.

The purpose of this study was to develop and psychometrically evaluate a tool to measure nurses’ knowledge of, attitude toward and practice regarding the elder abuse phenomenon.

This study is methodological research that was conducted in two stages. In the first stage, the available tools related to knowledge, attitude and practice regarding elder abuse were identified through an extensive review of theoretical principles, previous research and related articles. The initial items were extracted and categorized. In the second stage, the psychometric properties of the tool were examined by assessing face validity, content validity, construct validity, internal consistency and stability. Four hundred nurses working in the hospitals of Shahid Beheshti University of Medical Sciences were selected to determine the validity of the structure.

The initial tool consisted of 114 items extracted, 34 of which were removed according to the experts’ opinions. The face validity of the 80-item questionnaire was then examined. The number of the items was reduced to 74 after measuring the face validity. After the qualitative measurement of the content validity, three items were eliminated. After measuring the content validity using a quantitative approach, 8 other items were removed and 63 items remained. According to the content validity index, 1 more item was removed, reducing the number to 62. The construct validity approved three dimensions of knowledge, attitude and practice. Cronbach's alpha coefficient was calculated to be 0.84. The stability was also confirmed through test–retest with a value of 0.85 for the whole scale.

The tool developed for assessing nurses’ knowledge, attitude and practice regarding elder abuse has acceptable dependability and credibility. Given the advantages of this tool, including the simplicity and fluency of sentences, and the comprehensive evaluation of nurses’ knowledge, attitude and practice regarding elder abuse, it is recommended to use this tool in relevant future studies.

The present study aims to investigate the psychometric properties of the picture story exercise (PSE), a tool for measuring implicit motivations in Iran.

The research method is descriptive correlation and was conducted in two studies. In the first study 24 psychology master’s students were selected by convenience sampling method and tested them to check retest and inter-coder reliability. The second study investigated the correlation between self-reports and the PSE test on a sample of managers. Its statistical population comprised all the managers of a refinery company, 50 people were selected by convenience sampling method. To check the concurrent validity of the PSE test, the participants of the second study, completing the PSE, also completed the needs questionnaire of Steers and Porter (1979).

The findings showed that the PSE test in the Iranian sample had high retest reliability (0.62 on mean) and inter-coder reliability (0.87 on mean), and, following previous research, it does not show a significant relationship with self-reported motives.

PSE can be used in future research as a tool that has demonstrated its reliability and validity in the Iranian sample.

Measurement of implicit motives is a practical factor for predicting people’s behavior, the necessity of using tools that can accurately evaluate implicit motives is strongly felt. Taking into account the fact that so far, in Iranian samples, implicit motivations have not been measured, therefore, the current research is trying to answer this question, whether one of the most important and prominent tools that were made for this purpose and used in various studies can also be used in Iranian samples.

This study aims to adapt and validate the Job Crafting Scale (JCS), a measure based on the conceptualization of job crafting of the job demands–resources theory, for a sample of Portuguese workers and to test its psychometric properties regarding validity (factor, convergent, discriminant, and criterion) and reliability.

Two subsamples (n1 = 315 and n2 = 329) of Portuguese workers aged 18 years old and over participated in this research. Exploratory factor analysis and confirmatory factor analysis were used to assess the factor structure.

The results indicated that the Portuguese version of the JCS, with 18 items, has a factor structure composed of four-correlated factors. Furthermore, the results demonstrated the existence of factor, discriminant, and criterion validity, as well as reliability.

This study provides a job crafting measure adapted to the Portuguese language that can serve as a diagnostic tool for workers and organizations.

Este estudio tuvo como objetivo adaptar y validar la Job Crafting Scale (JCS), una medida basada en la conceptualización de job crafting de la Teoría de Demandas-Recursos, para una muestra de trabajadores portugueses y probar sus propiedades psicométricas en cuanto a validez (factor, convergente, discriminante y de criterio) y confiabilidad.

En esta investigación participaron dos submuestras (n1 = 315 y n2 = 329) de trabajadores portugueses de 18 años o más. Se utilizó un análisis factorial exploratorio y un análisis factorial confirmatorio para evaluar la estructura factorial.

Los resultados indicaron que la versión portuguesa del JCS, con 18 ítems, tiene una estructura factorial compuesta por cuatro factores correlacionados. Además, los resultados demostraron la existencia de validez factorial, discriminante y de criterio, así como confiabilidad.

Este estudio proporciona una medida de job crafting adaptada a la lengua portuguesa que puede servir como herramienta de diagnóstico para trabajadores y organizaciones.

Este estudo teve como objetivo adaptar e validar a Job Crafting Scale (JCS), uma medida baseada na conceptualização de job crafting da Teoria das Exigências-Recursos, numa amostra de trabalhadores portugueses e testar as suas propriedades psicométricas quanto à validade (fatorial, convergente, discriminante e de critério) e fiabilidade.

Duas subamostras (n1 = 315 e n2 = 329) compostas por trabalhadores portugueses com 18 ou mais anos foram recolhidas. Foram utilizadas uma análise fatorial exploratória e uma análise fatorial confirmatória para analisar a estrutura fatorial.

Os resultados obtidos indicaram que a versão portuguesa da JCS, composta por 18 itens, possui uma estrutura fatorial composta por quatro fatores correlacionados. Além disso, os resultados demonstraram a existência de validade fatorial, discriminante e de critério, bem como de fiabilidade.

Este estudo fornece uma medida de job crafting adaptada para a língua portuguesa que pode servir como ferramenta de diagnóstico para trabalhadores e organizações.

This paper aims to report the development of the multiparty collaborative leadership scale (MCLS) that assesses four dimensions of collaborative leadership that have been defined in the literature regarding the functions of collaborative leadership in intra- and interorganizational settings.

The authors have tested the validity and reliability of the MCLS in a sample of 110 managers and professionals who participated in five multiparty collaboration workshops, each lasting for two days. The authors used multilevel analyses to test the construct, discriminant and predictive validity of the MCLS.

The results generally supported the reliability and validity of the MCLS. The scale has good internal consistency and in terms of validation, the authors show that MCLS negatively predicts the conflictuality and positively predicts the collaborativeness of the leading party as well as trust in the multiparty system and its entitativity.

The MCLS can be used to extend literature on collaborative leadership and generate insights on the antecedents and consequences of effective collaborative leadership in multiparty systems.

Multiparty systems are set to deal with important societal challenges and mediators involved in multiparty issues are asked to settle important international disputes and conflicts. Understanding collaborative leadership in such systems and its role in establishing effective multiparty collaboration is key. The MCLS can be used as a research instrument and as a development tool toward realizing much-needed collaboration.

The authors present a first attempt to develop a short scale to assess collaborative leadership in complex systems in which participating stakeholders lack position power.