Search results
1 – 10 of over 5000Research serves to elucidate and tackle real-world issues (e.g. capitalizing opportunities and solving problems). Critical to research is the concept of validity, which gauges the…
Abstract
Purpose
Research serves to elucidate and tackle real-world issues (e.g. capitalizing opportunities and solving problems). Critical to research is the concept of validity, which gauges the extent to which research is adequate and appropriate in representing what it intends to measure and test. In this vein, this article aims to present a typology of validity to aid researchers in this endeavor.
Design/methodology/approach
Employing a synthesis approach informed by the 3Es of expertise, experience, and exposure, this article maintains a sharp focus on delineating the concept of validity and presenting its typology.
Findings
This article emphasizes the importance of validity and explains how and when different types of validity can be established. First and foremost, content validity and face validity are prerequisites assessed before data collection, whereas convergent validity and discriminant validity come into play during the evaluation of the measurement model post-data collection, while nomological validity and predictive validity are crucial in the evaluation of the structural model following the evaluation of the measurement model. Additionally, content, face, convergent and discriminant validity contribute to construct validity as they pertain to concept(s), while nomological and predictive validity contribute to criterion validity as they relate to relationship(s). Last but not least, content and face validity are established by humans, thereby contributing to the assessment of substantive significance, whereas convergent, discriminant, nomological and predictive validity are established by statistics, thereby contributing to the assessment of statistical significance.
Originality/value
This article contributes to a deeper understanding of validity’s multifaceted nature in research, providing a practical guide for its application across various research stages.
Details
Keywords
Philipp Kruse, Eleanor Meda Chipeta and Robert Venter
The creation of positive social change (PSC) is considered the primary success criterion when evaluating social enterprise performance. However, despite a proliferation of…
Abstract
Purpose
The creation of positive social change (PSC) is considered the primary success criterion when evaluating social enterprise performance. However, despite a proliferation of PSC-measurements, their empirical validity and applicability in emerging economies remain largely unclear. The quantitative study examines the validity of the PSC-measurement approaches proposed by Bloom and Smith (2010; Bloom and Smith approach [BSA]) and Weaver (2020b; Weaver approach [WA]) in South Africa.
Design/methodology/approach
Investigating a representative sample of 347 social entrepreneurs from Gauteng and Limpopo provinces, the authors use questionnaire data to explore the factorial, convergent and discriminant validity of both PSC-measurement approaches. Statistically, this is done by applying factorial and correlation analyses.
Findings
The results yield acknowledgeable differences. BSA has a high factorial and convergent validity, while its discriminant validity remains doubtful. For WA, problems concerning factorial validity occur.
Research limitations/implications
Despite limited generalizability, the authors provide a first guideline for scholars regarding the empirical validity of BSA and WA outside the context of developed economies.
Originality/value
The current study sheds light on the validity of two PSC-measurement approaches in an emerging economy context. This way, the authors contribute to the field by addressing the scarcity of empirical research and the restricted scope of developed economies regarding PSC-measurement.
Details
Keywords
Ellen Roemer, Florian Schuberth and Jörg Henseler
One popular method to assess discriminant validity in structural equation modeling is the heterotrait-monotrait ratio of correlations (HTMT). However, the HTMT assumes…
Abstract
Purpose
One popular method to assess discriminant validity in structural equation modeling is the heterotrait-monotrait ratio of correlations (HTMT). However, the HTMT assumes tau-equivalent measurement models, which are unlikely to hold for most empirical studies. To relax this assumption, the authors modify the original HTMT and introduce a new consistent measure for congeneric measurement models: the HTMT2.
Design/methodology/approach
The HTMT2 is designed in analogy to the HTMT but relies on the geometric mean instead of the arithmetic mean. A Monte Carlo simulation compares the performance of the HTMT and the HTMT2. In the simulation, several design factors are varied such as loading patterns, sample sizes and inter-construct correlations in order to compare the estimation bias of the two criteria.
Findings
The HTMT2 provides less biased estimations of the correlations among the latent variables compared to the HTMT, in particular if indicators loading patterns are heterogeneous. Consequently, the HTMT2 should be preferred over the HTMT to assess discriminant validity in case of congeneric measurement models.
Research limitations/implications
However, the HTMT2 can only be determined if all correlations between involved observable variables are positive.
Originality/value
This paper introduces the HTMT2 as an improved version of the traditional HTMT. Compared to other approaches assessing discriminant validity, the HTMT2 provides two advantages: (1) the ease of its computation, since HTMT2 is only based on the indicator correlations, and (2) the relaxed assumption of tau-equivalence. The authors highly recommend the HTMT2 criterion over the traditional HTMT for assessing discriminant validity in empirical studies.
Details
Keywords
Špela Orehek and Gregor Petrič
The concept of information security culture, which recently gained increased attention, aims to comprehensively grasp socio-cultural mechanisms that have an impact on…
Abstract
Purpose
The concept of information security culture, which recently gained increased attention, aims to comprehensively grasp socio-cultural mechanisms that have an impact on organizational security. Different measurement instruments have been developed to measure and assess information security culture using survey-based tools. However, the content, breadth and face validity of these scales vary greatly. This study aims to identify and provide an overview of the scales that are used to measure information security culture and to evaluate the rigor of reported scale development and validation procedures.
Design/methodology/approach
Papers that introduce a new or adapt an existing scale of information security culture were systematically reviewed to evaluate scales of information security culture. A standard search strategy was applied to identify 19 relevant scales, which were evaluated based on the framework of 16 criteria pertaining to the rigor of reported operationalization and the reported validity and reliability of the identified scales.
Findings
The results show that the rigor with which scales of information security culture are validated varies greatly and that none of the scales meet all the evaluation criteria. Moreover, most of the studies provide somewhat limited evidence of the validation of scales, indicating room for further improvement. Particularly, critical issues seem to be the lack of evidence regarding discriminant and criterion validity and incomplete documentation of the operationalization process.
Research limitations/implications
Researchers focusing on the human factor in information security need to reach a certain level of agreement on the essential elements of the concept of information security culture. Future studies need to build on existing scales, address their limitations and gain further evidence regarding the validity of scales of information security culture. Further research should also investigate the quality of definitions and make expert assessments of the content fit between concepts and items.
Practical implications
Organizations that aim to assess the level of information security culture among employees can use the results of this systematic review to support the selection of an adequate measurement scale. However, caution is needed for scales that provide limited evidence of validation.
Originality/value
This is the first study that offers a critical evaluation of existing scales of information security culture. The results have decision-making value for researchers who intend to conduct survey-based examinations of information security culture.
Details
Keywords
To elaborate the nature of fact-checking in the domain of political information by examining how fact-checkers assess the validity of claims concerning the Russo-Ukrainian…
Abstract
Purpose
To elaborate the nature of fact-checking in the domain of political information by examining how fact-checkers assess the validity of claims concerning the Russo-Ukrainian conflict and how they support their assessments by drawing on evidence acquired from diverse sources of information.
Design/methodology/approach
Descriptive quantitative and qualitative content analysis of 128 reports written by the fact-checkers of Snopes – an established fact-checking organisation – during the period of 24 February 2022 – 28 June, 2023. For the analysis, nine evaluation grounds were identified, most of them inductively from the empirical material. It was examined how the fact-checkers employed such grounds while assessing the validity of claims and how the assessments were bolstered by evidence acquired from information sources such as newspapers.
Findings
Of the 128 reports, the share of assessments indicative of the invalidity of the claims was 54.7%, while the share of positive ratings was 26.7%. The share of mixed assessments was 15.6%. In the fact-checking, two evaluation grounds, that is, the correctness of information and verifiability of an event presented in a claim formed the basis for the assessment. Depending on the topic of the claim, grounds such as temporal and spatial compatibility, as well as comparison by similarity and difference occupied a central role. Most popular sources of information offering evidence for the assessments include statements of government representatives, videos and photographs shared in social media, newspapers and television programmes.
Research limitations/implications
As the study concentrated on fact-checking dealing with political information about a specific issue, the findings cannot be extended to concern the fact-checking practices in other contexts.
Originality/value
The study is among the first to characterise how fact-checkers employ evaluation grounds of diverse kind while assessing the validity of political information.
Details
Keywords
The purpose of this study is to contribute with knowledge about how valid research data in biodiversity citizen science are produced through information practices and how notions…
Abstract
Purpose
The purpose of this study is to contribute with knowledge about how valid research data in biodiversity citizen science are produced through information practices and how notions of credibility and authority emerge from these practices.
Design/methodology/approach
Data were collected through an empirical, interview-based study of the information practices of 15 participants active in the vicinity of the Swedish biodiversity citizen science information system Artportalen. Interview transcripts were analysed abductively and qualitatively through a coding scheme by working back and forth between theory and data. Values of credibility, authority and validity of research data were unfolded through a practice-oriented perspective to library and information studies by utilising the theoretical lens of boundary objects.
Findings
Notions of credibility, authority and validity emerge through participant activities of transforming species observations to data, supplementing reports with objects of trust, augmenting identification through authority outreach and assessing credibility via peer monitoring. Credibility, authority and validity of research data are shown to be co-constructed in a distributed fashion by the participants and the information system.
Originality/value
The article extends knowledge about information practices in emerging, heterogeneous scholarly settings by focussing on the complex co-construction of credibility, authority and validity in relation to data production.
Details
Keywords
Naji Mansour Nomran and Razali Haron
There is much debate in the literature about how the performance of Islamic banks (IBs) should be measured. Basically, IBs’ business models are different from that of conventional…
Abstract
Purpose
There is much debate in the literature about how the performance of Islamic banks (IBs) should be measured. Basically, IBs’ business models are different from that of conventional banks; thus, the performance of IBs should be measured by using a Sharīʿah-based approach. This paper considers zakat (Islamic tax) as an alternative indicator to measure the performance of IBs. This paper aims to examine whether zakat ratios can be used as Islamic performance (ISPER) indicators for IBs besides the conventional performance (COPER) indicators.
Design/methodology/approach
The investigation covered a sample of 214 yearly observations of 37 IBs located in Indonesia, Malaysia, Bahrain, Saudi Arabia and the United Arab Emirates for the period 2007–2015. This study used a single-factor congeneric model and confirmatory factor analysis, performed using the AMOS 23.0 software.
Findings
The findings assert that the discriminant validity of multi-bank performance, as measured by ISPER [zakat on assets (ZOA) and zakat on equity (ZOE)] and COPER indicators (return on assets, return on equity and operational efficiency in terms of assets), is very high. Hence, ISPER and COPER measurements are valid, either together to measure the multi-performance of IBs from both the Islamic and conventional perspectives, or independently as each measurement is valid to measure the Islamic and conventional performance if it is used separately.
Research limitations/implications
This paper does not investigate whether the findings are constant across time. This represents one of the limitations of this study.
Practical implications
It is strongly recommended that IBs calculate and disclose zakat ratios, particularly ZOA and ZOE, in their annual reports. Researchers and academicians should use these ratios for measuring the ISPER of IBs, either along with COPER or separately.
Originality/value
Empirical evidence is provided in this paper on the development and validity of zakat ratios as ISPER indicators in the Islamic banking industry. Zakat ratios are suitable indicators that can measure IBs’ performance and achieve the goals of IBs as well as those of Islamic economics. Technically, zakat has a dynamic ability to reflect the profitability of IBs. The more the IBs generate profit, the more they pay zakat. Furthermore, the greater the total assets of IBs, the higher the amount of zakat that they should pay. Thus, zakat ratios can be used as profitability measurements as in the case of tax ratios.
Details
Keywords
This study aims to investigate the effects of mineral rents, conflict and population growth on countries' growth, with a specific interest in 13 selected economies in Sub-Saharan…
Abstract
Purpose
This study aims to investigate the effects of mineral rents, conflict and population growth on countries' growth, with a specific interest in 13 selected economies in Sub-Saharan Africa.
Design/methodology/approach
This paper uses a combination of research methods: the pooled ordinary least squares (OLS), the fixed effect and the system generalized method of moment (GMM). The consistent estimator (system GMM), which provides the paper's empirical findings, remedies the inherent endogeneity bias in the model formulation. The utilized panel dataset for the study spans from 1980 to 2022.
Findings
The study suggests that mineral rents positively affect countries' growth by about 0.407 percentage points in the short run. The study further demonstrates the long-run negative impacts of population growth rates and prevalence of civil war on economic growth. The empirical work of the study reveals that an increase in the number of international borders within the group promotes mineral conflicts, which impedes economic growth. Evidence from the specification tests performed in the study confirmed the validity of the empirical results.
Social implications
Mineral rents, if well managed and conditioned on good institutions, are a blessing to an economy, contrary to the assumptions that mineral resources are a curse. The utilization of mineral rents in Sub-Saharan Africa for economic growth depends on several factors, notably the level of mineral conflicts, population growth rates, institutional factors and the ability to contain civil war, among others.
Originality/value
This study is the first attempt in the post-coronavirus disease 2019 (COVID-19) era to revisit the investigation of the impacts of mineral rents, conflict and population growth rates on the countries' growth while controlling for the potential implications of the qualities of institutions. One of the significant contributions of the study is the identification of high population growth rates as one of the primary drivers of mineral conflicts that impede economic growth in the states with enormous mineral deposits in Sub-Saharan Africa. The crucial inference drawn from the study is that mineral rents positively impact countries' growth, even with inherent institutional challenges, although the results could be better with good institutions.
Details
Keywords
Luna Leoni, Marco Ardolino, Jamal El Baz, Ginetta Gueli and Andrea Bacchetti
This paper aims to provide and empirically test a conceptual model in which artificial intelligence (AI), knowledge management processes (KMPs) and supply chain resilience (SCR…
Abstract
Purpose
This paper aims to provide and empirically test a conceptual model in which artificial intelligence (AI), knowledge management processes (KMPs) and supply chain resilience (SCR) are simultaneously considered in terms of their reciprocal relationships and impact on manufacturing firm performance (MFP).
Design/methodology/approach
In the study, six hypotheses have been developed and tested through an empirical survey administered to 120 senior executives of Italian manufacturing firms. The data analysis has been carried out via the partial least squares structural equation modelling approach, using the Advanced Analysis for Composites 2.0 variance-based software program.
Findings
Using a conceptual model validated using an empirical survey, the study sheds light on the relationships between AI, KMPs and SCR, as well as their impacts on MFP. In particular, the authors show the positive effects of the adoption of AI on KMPs, as well as the influence of KMPs on SCR and MFP. Finally, the authors demonstrate that KMPs act as a mediator through which AI affects SCR and MFP.
Practical implications
This study highlights the critical role of KMPs for manufacturing firms that can deploy AI to stimulate KMPs and through attaining a high level of the latter might succeed in enhancing both their SCR and MFP.
Originality/value
This study demonstrates that manufacturing firms interested in properly applying AI to ameliorate their performance and resilience must carefully consider KMPs as a mediator mechanism.
Details
Keywords
Ida Untari, Achmad Arman Subijanto, Dyah Kurnia Mirawati, Ari Natalia Probandari and Rossi Sanusi
The purpose of this paper is to conduct systematic reviews on Indonesian papers, to examine the most recent evidence of the efficacy of the combination of cognitive training and…
Abstract
Purpose
The purpose of this paper is to conduct systematic reviews on Indonesian papers, to examine the most recent evidence of the efficacy of the combination of cognitive training and physical exercise, and to make recommendations in order to improve prevention, care and treatment services in elderly patients with mild cognitive impairment (MCI).
Design/methodology/approach
The databases of Cochrane, Medline, NIH (US National Library Medicine), ProQuest, EbscoHost, Clinical Key, EMBASE, Medical Librarian (TWE) in Ovid, Science Direct, Scopus, The Lancet Global Health, PubMed, Emerald, Indonesian National Library, Google Scholar, Google Indonesia, and Garuda Portal were systematically searched using Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to obtain empirical papers published between June 1976 and January 2018.
Findings
Out of the 3,293 articles collected, 10 were included in this analysis. The result of this combined meta-analysis compares the combination therapy group (cognitive therapy and physical exercise) with a control group. It shows that the control group was likely to experience MCI 1.65 times more often than the combination therapy group. According to the result acquired from the synthesized meta-analysis, the control group experienced MCI 1.65 times higher than the combination therapy. The finding is proven to be statistically significant (95% CI= 1.42–1.93).
Research limitations/implications
The research considers only English and Indonesian articles.
Practical implications
It is important to explore the most effective training characteristics in a special combined intervention differentiated by the duration, frequency, intervention, type and combination mode. There is a need for further investigation that focuses on the physiological mechanisms underlying the positive effects, by inserting a more comprehensive neuro-imaging measurement to assess specifically the domain that benefits in terms of cognitive functions and molecular markers. Finally, exploratory studies are definitely required, which will specifically examine maintenance and treatment effects as well as derive theoretical explanations related to the interventions and predictors.
Social implications
A combination of cognitive training and physical exercise intervention may improve the global health or cognitive functions.
Originality/value
A combination of cognitive training and physical exercise has been found to improve prevention, care and treatment services in elderly patients with MCI. There is an increase in value in comparison to the study of Karssemeijer, which considered five Indonesian articles.
Details