Search results

Case study research has been applied across numerous fields and provides an established methodology for exploring and understanding various research contexts. This paper aims to aid in developing methodological rigor by investigating the approaches of establishing validity and reliability.

Based on a systematic review of relevant literature, this paper catalogs the use of validity and reliability measures within academic publications between 2008 and 2018. The review analyzes case study research across 15 peer-reviewed journals (total of 1,372 articles) and highlights the application of validity and reliability measures.

The evidence of the systematic literature review suggests that validity measures appear well established and widely reported within case study–based research articles. However, measures and test procedures related to research reliability appear underrepresented within analyzed articles.

As shown by the presented results, there is a need for more significant reporting of the procedures used related to research reliability. Toward this, the features of a robust case study protocol are defined and discussed.

The effect of dynamic capabilities on operational excellence and the moderating effect of environmental dynamism on the relationship between operational excellence and dynamic capabilities in the apparel industry in Sri Lanka were investigated while developing new psychometric scales to assess operational excellence and dynamic capacities constructs.

We followed the exploratory sequential research design with a mixed-method research approach, aligning with the pragmatic research philosophy. Thus, both qualitative and quantitative research methods were followed.

Dynamic capabilities positively affect operational excellence, and environmental dynamism moderates the relationship between operational excellence and dynamic capabilities in the apparel industry in Sri Lanka such that when a higher environmental dynamism exists, a weaker positive relationship exists between dynamic capabilities and operational excellence. The two main dimensions of the operational excellence construct are continuous improvement of sustainable operational performance and sustainable competitive advantages. It empirically confirmed that sensing, seizing and reconfiguring capabilities are the three main dimensions of the dynamic capabilities construct.

This study was limited to the apparel industry in Sri Lanka. This research phenomenon should be explored in other industrial sectors worldwide to generalize the findings. The practitioners in the apparel sector may improve the organizational dynamic capabilities to achieve operational excellence and keep a strong positive relationship between dynamic capabilities and operational excellence in a highly dynamic environment if they address out-of-family situations with out-of-the-box thinking.

We generated two new empirical findings: (1) dynamic capabilities positively affect operational excellence, and (2) environmental dynamism moderates the relationship between dynamic capabilities and operational excellence. Also, we introduced validated new scales for assessing operational excellence and dynamic capabilities.

The article aims to present the results of adapting the team boosting behaviors (TBB) scale to Polish cultural conditions and validating it.

The research methodology consisted of three steps. In the first step, I translated the TBB scale into Polish using a rigorous back-translation method. Next, to assess content validity, nine domain experts reviewed the initial version of the instrument for clarity and relevance. Finally, I applied the scale to a sample of 532 team members and underwent thorough psychometric testing to assess construct validity. I employed structural equation modeling (SEM) with the partial least squares (PLS) factor-based algorithm technique for confirmatory factor analysis to assess the scale’s reliability and validity.

After development, the Polish version of the TBB scale kept its three sub-scale structures. However, the validation process led to a slight reduction in the number of test items compared to the original scale.

The findings imply that the Polish version of the scale is a valid and reliable tool for assessing TBB. However, I recommend additional studies to confirm this instrument’s structure.

The results confirmed the reliability and relevance of the tool for measuring TBBs in Polish cultural conditions. The tool provides the basis for implementing further research with the TBB construct in Poland and internationally.

Although the fitness switching costs scale (FSCS) was shown to have sound psychometric properties, the length of the 54-item may impose burdens on survey participants and present methodological and analytic challenges for researchers and practitioners. Therefore, the present study shortened and validated two versions of the FSCS, namely the 33-item FSCS (FSCS-33) and the 11-item FSCS (FSCS-11).

In Study 1 (n = 411), the most useful items from the FSCS for the FSCS-33 and FSCS-11 were identified using item response theory (IRT). Study 2 (n = 391) and Study 3 (n = 400) assessed the psychometric properties of the FSCS-33 and FSCS-11, respectively, using partial least squares structural equation modeling.

The FSCS-33 and FSCS-11 demonstrated strong reliability and validity in assessing switching costs in fitness centers.

The psychometrically sound short-form scales provide researchers and practitioners with convenient and accurate means of measuring switching costs in fitness centers.

The present study aims to investigate the psychometric properties of the picture story exercise (PSE), a tool for measuring implicit motivations in Iran.

The research method is descriptive correlation and was conducted in two studies. In the first study 24 psychology master’s students were selected by convenience sampling method and tested them to check retest and inter-coder reliability. The second study investigated the correlation between self-reports and the PSE test on a sample of managers. Its statistical population comprised all the managers of a refinery company, 50 people were selected by convenience sampling method. To check the concurrent validity of the PSE test, the participants of the second study, completing the PSE, also completed the needs questionnaire of Steers and Porter (1979).

The findings showed that the PSE test in the Iranian sample had high retest reliability (0.62 on mean) and inter-coder reliability (0.87 on mean), and, following previous research, it does not show a significant relationship with self-reported motives.

PSE can be used in future research as a tool that has demonstrated its reliability and validity in the Iranian sample.

Measurement of implicit motives is a practical factor for predicting people’s behavior, the necessity of using tools that can accurately evaluate implicit motives is strongly felt. Taking into account the fact that so far, in Iranian samples, implicit motivations have not been measured, therefore, the current research is trying to answer this question, whether one of the most important and prominent tools that were made for this purpose and used in various studies can also be used in Iranian samples.

This study aims to adapt and validate the Job Crafting Scale (JCS), a measure based on the conceptualization of job crafting of the job demands–resources theory, for a sample of Portuguese workers and to test its psychometric properties regarding validity (factor, convergent, discriminant, and criterion) and reliability.

Two subsamples (n1 = 315 and n2 = 329) of Portuguese workers aged 18 years old and over participated in this research. Exploratory factor analysis and confirmatory factor analysis were used to assess the factor structure.

The results indicated that the Portuguese version of the JCS, with 18 items, has a factor structure composed of four-correlated factors. Furthermore, the results demonstrated the existence of factor, discriminant, and criterion validity, as well as reliability.

This study provides a job crafting measure adapted to the Portuguese language that can serve as a diagnostic tool for workers and organizations.

Este estudio tuvo como objetivo adaptar y validar la Job Crafting Scale (JCS), una medida basada en la conceptualización de job crafting de la Teoría de Demandas-Recursos, para una muestra de trabajadores portugueses y probar sus propiedades psicométricas en cuanto a validez (factor, convergente, discriminante y de criterio) y confiabilidad.

En esta investigación participaron dos submuestras (n1 = 315 y n2 = 329) de trabajadores portugueses de 18 años o más. Se utilizó un análisis factorial exploratorio y un análisis factorial confirmatorio para evaluar la estructura factorial.

Los resultados indicaron que la versión portuguesa del JCS, con 18 ítems, tiene una estructura factorial compuesta por cuatro factores correlacionados. Además, los resultados demostraron la existencia de validez factorial, discriminante y de criterio, así como confiabilidad.

Este estudio proporciona una medida de job crafting adaptada a la lengua portuguesa que puede servir como herramienta de diagnóstico para trabajadores y organizaciones.

Este estudo teve como objetivo adaptar e validar a Job Crafting Scale (JCS), uma medida baseada na conceptualização de job crafting da Teoria das Exigências-Recursos, numa amostra de trabalhadores portugueses e testar as suas propriedades psicométricas quanto à validade (fatorial, convergente, discriminante e de critério) e fiabilidade.

Duas subamostras (n1 = 315 e n2 = 329) compostas por trabalhadores portugueses com 18 ou mais anos foram recolhidas. Foram utilizadas uma análise fatorial exploratória e uma análise fatorial confirmatória para analisar a estrutura fatorial.

Os resultados obtidos indicaram que a versão portuguesa da JCS, composta por 18 itens, possui uma estrutura fatorial composta por quatro fatores correlacionados. Além disso, os resultados demonstraram a existência de validade fatorial, discriminante e de critério, bem como de fiabilidade.

Este estudo fornece uma medida de job crafting adaptada para a língua portuguesa que pode servir como ferramenta de diagnóstico para trabalhadores e organizações.

This paper aims to report the development of the multiparty collaborative leadership scale (MCLS) that assesses four dimensions of collaborative leadership that have been defined in the literature regarding the functions of collaborative leadership in intra- and interorganizational settings.

The authors have tested the validity and reliability of the MCLS in a sample of 110 managers and professionals who participated in five multiparty collaboration workshops, each lasting for two days. The authors used multilevel analyses to test the construct, discriminant and predictive validity of the MCLS.

The results generally supported the reliability and validity of the MCLS. The scale has good internal consistency and in terms of validation, the authors show that MCLS negatively predicts the conflictuality and positively predicts the collaborativeness of the leading party as well as trust in the multiparty system and its entitativity.

The MCLS can be used to extend literature on collaborative leadership and generate insights on the antecedents and consequences of effective collaborative leadership in multiparty systems.

Multiparty systems are set to deal with important societal challenges and mediators involved in multiparty issues are asked to settle important international disputes and conflicts. Understanding collaborative leadership in such systems and its role in establishing effective multiparty collaboration is key. The MCLS can be used as a research instrument and as a development tool toward realizing much-needed collaboration.

The authors present a first attempt to develop a short scale to assess collaborative leadership in complex systems in which participating stakeholders lack position power.

The current literature on school teacher-created summative assessment lacks a clear consensus regarding its definition and key principles. The purpose of this research was therefore to arrive at a cohesive understanding of what constitutes effective summative assessment.

Conducting a systematic literature review of 95 studies, this research adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The objective was to identify the core principles governing effective teacher-created summative assessments.

The study identified five key principles defining effective summative assessment creation: validity, reliability, fairness, authenticity and flexibility.

The expansiveness of education research is such that not all relevant studies may have been identified, particularly outside of mainstream databases. This study considered only the school environment, so contextual limitations will exist.

To the best of the authors’ knowledge, this study contributes original insights by proposing a holistic definition that can facilitate consensus-building in further research. The assimilation of core principles guided the development of quality indicators beneficial for teacher practice. The comprehensive definition, key principles and quality indicators offer a unique perspective on summative assessment discourse.

Previous studies highlighted a shortage of scale to measure digital citizenship among Indians. Accordingly, this study examined the psychometric properties of Jones and Mitchell’s (2016) digital citizenship scale in the Indian context with the help of two independent studies.

In the first study, the factorial validity of the scale was determined using the exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). In the second study, Cronbach’s alpha (CA) and composite reliability (CR) values checked the internal consistency reliability of the scale. Also, convergent, discriminant and criterion validity were examined.

EFA recommended a two-factor structure explaining 58.219% of the total variance. The item loadings varied from 0.540 to 0.793. The Indian version of the scale showed one variation. In the original digital citizenship scale, the seventh statement (“I like to present myself online as someone was making positive choices”) was part of factor 1 (online respect); however, this study suggested that the seventh statement should be included in factor 2 (online civic engagement). In the second study, the acceptable (>0.70) values of CA and CR concluded the internal consistency reliability of the scale. The convergent validity was suggested by average variance explained values (>0.50). In addition, as expected, the Indian version of the digital citizenship scale reported a statistically significant positive correlation with Internet self-efficacy and a considerable negative relationship with cyberbullying. These findings concluded the criterion validity of the scale.

The Indian version of the digital citizenship scale showed appreciable psychometric properties among Indian students.

To improve the loan repayment performance (LRP) of microfinance banks (MFBs) in Pakistan, this study aims to look at the direct impact of multiple borrowing (MB) on LRP and client-business performance (CBP), as well as the direct impact of CBP on LRP. The moderating function of pandemic factors in the relationship between MB and CBP, as well as the mediating effect of CBP in the association between MB and LRP, was also investigated in this study.

A questionnaire was used to obtain data from 531 lower-level workers of microfinance institutions (MFIs) for the study. The respondents were chosen using stratified sampling, which divided the target population into four influential groups: lending officers in agriculture, lending officers in businesses, lending officers in gold loans and lending officers in salary loans. In this study, a two-stage structural equation modeling approach was used, including a measurement model (outer model) and a structural model (inner model). The validity and reliability of the questionnaire were investigated using the measurement model (outer model), whereas PLS-SEM bootstrapping was performed to test the hypothesis and find the relationship among different underpinning constructs by using the structural model (inner model).

The outcomes of this study demonstrate that MB has a direct impact on CBP, and that CBP has a direct impact on LRP. MB, on the contrary, had no direct and significant impact on LRP in this study. The idea that CBP mediates the relationship between MB and LRP, as well as the moderating effect of pandemic factors on the relationship between MB and CBP, is supported by this research.

Until now, the influence of MB on LRP via the mediating role of CBP and the moderating role of a pandemic factor in the setting of Pakistani MFBs has received little attention. During the COVID-19 pandemic, this research also aids MFBs in better understanding MB and its impact on LRP. Furthermore, based on the findings of this study, Pakistani MFIs can enhance their LRP by implementing new lending regulations, particularly with reference to MB and the COVID-19 pandemic.