Search results

Addresses the standardization of the measurements and the labels for concepts commonly used in the study of work organizations. As a reference handbook and research tool, seeks to improve measurement in the study of work organizations and to facilitate the teaching of introductory courses in this subject. Focuses solely on work organizations, that is, social systems in which members work for money. Defines measurement and distinguishes four levels: nominal, ordinal, interval and ratio. Selects specific measures on the basis of quality, diversity, simplicity and availability and evaluates each measure for its validity and reliability. Employs a set of 38 concepts ‐ ranging from “absenteeism” to “turnover” as the handbook’s frame of reference. Concludes by reviewing organizational measurement over the past 30 years and recommending future measurement reseach.

In the public sector, Training and Experience (T & E) exams assess prior experience and are one of the most often used methods for selecting job applicants. This study uses a KSA approach, where raters judge the quality of job relevant prior experience, not its duration or quantity. It was hypothesized that an additional rater and a consensus meeting between raters would increase reliability and validity.

T & E and supervisory ratings were obtained over a 12-year period for 166 candidates seeking promotion to a budget analyst position. Validity was measured by the correlation between T & E scores and supervisory ratings. Consensus was required only for T & E scores differing by a specific amount (hybrid consensus).

Intraclass reliability was 0.73, 0.84, and 0.95 in the one-rater, two-rater, and hybrid consensus conditions with each coefficient greater than the next (p < 0.05) showing the benefit of multiple raters and consensus for reliability. Validity was significant at 0.21, 0.26, and 0.251 for each rating condition, respectively (two-tail test; p < 0.01). Validity was greater in the two-rater condition than in the one-rater condition (one-tail test; p < 0.05). Consensus did not improve validity beyond that of two raters. For consensus T & Es (n=76), two raters improved validity (one-tail test; p < 0.05), moving from 0.112 to 0.231 but not reliability; consensus improved reliability (two-tail test; p < 0.05) but not validity.

There has been a vacuum in T & E research for close to 20 years. Validity data are difficult to obtain but critical for meta-analysis. T & Es showed validity. Use of two raters improved validity but consensus did not increase the gain.

The purpose of this research is to add to our understanding of the antecedents of customer satisfaction by examining the effects of service reliability (Is the service “correctly” produced?) and service validity (Is the “correct” service produced?) of search, experience and credence services.

Service validity and service reliability were manipulated in scenarios describing service encounters with different types of services. Customer satisfaction was measured using questionnaires.

Service validity and service reliability independently affect customer satisfaction with search services. For experience services, service validity and service reliability are necessary conditions for customer satisfaction. For credence services, no effects of service validity were found but the effects of service reliability on customers' satisfaction were profound.

Scenarios provided a useful method to investigate customer evaluation of different types of service situations. A limitation of this method was that the participants were not observed in a real service situation but had to give their opinion on hypothetical scenarios.

For search and credence services, it is possible to compensate low service validity by providing a highly reliable service. However, managers of experience services should be aware that little can be gained when either service validity or service reliability is faulty.

The present study provides empirical data on the effects of service reliability and the thus far neglected effects of service validity and integrates these (new) concepts in the model of information verification.

Case study research has been applied across numerous fields and provides an established methodology for exploring and understanding various research contexts. This paper aims to aid in developing methodological rigor by investigating the approaches of establishing validity and reliability.

Based on a systematic review of relevant literature, this paper catalogs the use of validity and reliability measures within academic publications between 2008 and 2018. The review analyzes case study research across 15 peer-reviewed journals (total of 1,372 articles) and highlights the application of validity and reliability measures.

The evidence of the systematic literature review suggests that validity measures appear well established and widely reported within case study–based research articles. However, measures and test procedures related to research reliability appear underrepresented within analyzed articles.

As shown by the presented results, there is a need for more significant reporting of the procedures used related to research reliability. Toward this, the features of a robust case study protocol are defined and discussed.

The purpose of this paper is to shed light on the threats to quality in mixed methods accounting research, wherein quantitative and qualitative approaches are combined in data collection, analysis and interpretation.

The paper is framed according to three perspectives. The authors first synthesize the threats to validity and reliability in quantitative and qualitative parts of mixed methods research using the quality standards of each; they then introduce an integrative framework of mixed methods research quality by Teddlie and Tashakkori. Thereafter, they address the specific threats to quality that come to the fore when inferences from the quantitative and qualitative components of the study are combined to form meta‐inferences using a legitimation framework by Onwuegbuzie and Johnson.

The authors' analysis not only indicates a wide range of threats to the validity and reliability of mixed methods research in a range of categories, but also clarifies how the three perspectives described in this paper are linked and supplement each other.

Methodological research published in English over the last decade is emphasized to create an approach to assess mixed methods accounting research. The frameworks analyzed could still be studied in greater detail. Additional perspectives on the validity and reliability of mixed methods research could also be studied and developed.

This paper furthers our understanding of such new developments in methodological research, which may be of great importance to those conducting or evaluating empirical research.

Based on a comprehensive synthesis, this paper presents and analyzes theoretical frameworks potentially useful for scholars, students and practitioners. It focuses on both traditional and novel areas of validity and reliability in mixed methods research.

Despite the advantages of the case study method, its reliability and validity remain in doubt. Tests to establish the validity and reliability of qualitative data are important to determine the stability and quality of the data obtained. However, there is no single, coherent set of validity and reliability tests for each research phase in case study research available in the literature. This article presents an argument for the case study method in marketing research, examining various criteria for judging the quality of the method and highlighting various techniques, which can be addressed to achieve objectivity, and rigorous and relevant information for planning to marketing actions. The purpose of this article is to invite further research by discussing the use of various scientific techniques for establishing the validity and reliability in case study research. The article provides guidelines for achieving high validity and reliability for each phase in case study research.

The purposes of this study are: to examine the reliability and validity of the lodging quality index (LQI); and to assess the relative importance of the five dimensions of the LQI in the Canadian hotel context. The LQI was developed by Getty and Getty and published in 2003 in the International Journal of Contemporary Hospitality Management.

Data are collected from 200 Canadian respondents who had stayed in a hotel in Canada within the preceding three months. Data are examined using confirmatory factor analysis and regression analysis.

The findings support the reliability and the validity of the LQI's structure of five dimensions. The scale is shown to be a reliable instrument for measuring overall service quality and for predicting the satisfaction and behavioral intentions of hotel guests. In terms of the importance of the five dimensions, the study finds that “tangibility” and “communication” are the most important.

This is the first independent assessment of the reliability and validity of the LQI scale. The research provides valuable insights for hotel managers in Canada. Hoteliers should focus their efforts on the provision of good service quality on “tangibility” and “communication”.

Sustainable supply chain management (SSCM) ensures integration of socially, environmentally and economically feasible practices in entire supply chain. SSCM principles can be implemented to improve efficiency and productivity of a system by different attributes of the system. The purpose of this article is to identify the most appropriate existing (SSCM) framework that can be implemented suitably in Indian smart manufacturing industries.

Validity and reliability analysis on the existing SSCM frameworks was carried out with the help of empirical data collected using questionnaire survey methodology from various Indian smart manufacturing organizations. The empirical data were gathered from various experts from top- and middle-level management in different smart manufacturing organizations across the country. Further, factor analysis was carried on the collected data to estimate the unidimensionality of each SSCM frameworks. Cronbach's alpha value was used to assess reliability of each framework. Subsequently, the frequency distribution analysis was done to obtain familiar elements in the segregated frameworks based on validity and reliability analysis.

The work observed that only five SSCM frameworks have shown unidimensionality in terms of the elements or constructs. The work further found that these segregated frameworks have not shown sufficiently high level of reliability. Additionally, this work attempted frequency distribution analysis and observed that there were very few elements which were being repeatedly used in numerous frameworks proposed by researchers. Based on the findings of this work, the work concluded that there is acute need of a new SSCM framework for Indian smart manufacturing industries.

This study gathered empirical data from 388 Indian smart manufacturing organizations. Thus, before generalizing the findings of the study across the sectors, there is a possibility of some more explication.

The main purpose of this article is to explore the feasibility of the existing SSCM frameworks in Indian smart manufacturing sector. The study also assumes that the manufacturing managers and executives may have the complete understanding on the existing sustainable manufacturing frameworks and a chance to executing proper suitable framework in the respective manufacturing organization.

To describe the development of a survey instrument designed to measure consumer perceptions of the broadband adoption within the UK households.

A survey research approach was employed to achieve overall aim and following three objectives of this research: to identify initial items that may help to explain the broadband adoption behaviour and determine them employing an exploratory survey approach; to confirm the representativeness of items to a particular construct domain employing content validity approach; and finally, to test the instrument in order to confirm the reliability of items and construct validity.

The final outcome of the instrument development process that culminated from the confirmatory study was a parsimonious, 39‐item instrument, consisting of ten scales, all with acceptable levels of content validity, reliability and construct validity.

The developed instrument is relevant to both academic and practitioner communities who hold a particular interest in the study and management of broadband adoption from the household consumer perspective.

The most conspicuous contribution of the paper is to provide a reliable instrument that is fundamental to measure the household consumer's perceptions of adopting broadband internet.

The purpose of this study is to examine learning style instruments used in Arab countries to measure higher education students’ learning styles, identify the most common instruments and determine whether the reliability and validity of these instruments have been verified in Arab contexts.

A comprehensive review of the existing literature using several databases and search engines. Descriptive statistics, such as frequencies and percentages were used to present the results.

There are only a few published studies related to learning styles in Arab countries, with the majority published between 2012 and 2016 using samples drawn from Saudi Arabia, the United Arab Emirates and Iraq. The most common learning style instrument is the Felder–Silverman/Solomon Index of Learning Styles. The reliability and validity of this instrument require further investigation.

This study is not without limitations. First, it covers only publications in the English language. Second, the paper focuses on research involving higher education students. Third, only research that was available online was used in this study. Nonetheless, the findings have several implications for researchers, educators and human resource development managers. For researchers, this study highlights research gaps that need to be filled. It also serves as a basis for more analytical and in-depth studies. The data also helps educators become more informed about the learning style instruments commonly used in the Arab context and whether the results from these instruments are dependable. Human resource development managers can draw on these findings to choose instruments that have proven reliable and valid.

This study is the first attempt to examine learning style instruments used in Arab countries and to explore whether the reliability and validity of these instruments have been verified in Arab contexts. This paper is a useful contribution to research into learning styles and learning style instruments.