Search results

With the national emphasis on the use of evidence-based practices in educational settings, intervention research within the field of special education is being scrutinized. No Child Left Behind (NCLB) has defined evidence-based practices primarily by research that is based on quantitative, experimental designs (i.e., RCT). Although the use of appropriate experimental designs has an important place in educational research, defining evidence-based practices based on research design alone is limiting. One critical aspect of research that has not received much attention is the importance of rigorous and precise measurement and systematic replication of research findings. The purpose of this chapter is to review issues surrounding measurement and its effect on validity in intervention research in the field of behavioral disorders. Specifically, we discuss how more rigorous measurement can positively influence the internal, external, construct, and social validity of research findings. A review of current trends in behavioral disorders intervention research is discussed as well as implications for future research.

Addresses the standardization of the measurements and the labels for concepts commonly used in the study of work organizations. As a reference handbook and research tool, seeks to improve measurement in the study of work organizations and to facilitate the teaching of introductory courses in this subject. Focuses solely on work organizations, that is, social systems in which members work for money. Defines measurement and distinguishes four levels: nominal, ordinal, interval and ratio. Selects specific measures on the basis of quality, diversity, simplicity and availability and evaluates each measure for its validity and reliability. Employs a set of 38 concepts ‐ ranging from “absenteeism” to “turnover” as the handbook’s frame of reference. Concludes by reviewing organizational measurement over the past 30 years and recommending future measurement reseach.

New measures in marketing are invariably created by using a psychometric approach based on Churchill's “scale development” procedure. This paper aims to compare and contrast Churchill's procedure with Rossiter's content‐validity approach to measurement, called C‐OAR‐SE.

The comparison of the two procedures is by rational argument and forms the theoretical first half of the paper. In the applied second half of the paper, three recent articles from the Journal of Marketing (JM) that introduce new constructs and measures are criticized and corrected from the C‐OAR‐SE perspective.

The C‐OAR‐SE method differs from Churchill's method by arguing for: total emphasis on achieving high content validity of the item(s) and answer scale – without which nothing else matters; use of single‐item measures for “basic” constructs and for the first‐order components of “abstract” constructs; abandonment of the “reflective” measurement model, along with its associated statistical techniques of factor analysis and coefficient alpha, arguing that all abstract constructs must be measured as “formative”; and abandonment of external validation methods, notably multitrait‐multimethod analysis (MTMM) and structural equation modeling (SEM), to be replaced by internal content‐validation of the measure itself. The C‐OAR‐SE method can be applied – as demonstrated in the last part of the article – by any verbally intelligent researcher. However, less confident researchers may need to seek the assistance of one or two colleagues who fully understand the new method.

If a measure is not highly content‐valid to begin with – and none of the new measures in the JM articles criticized is highly content‐valid – then no subsequent psychometric properties can save it. Highly content‐valid measures are absolutely necessary for proper tests of theories and hypotheses, and for obtaining trustworthy findings in marketing.

C‐OAR‐SE is completely original and Rossiter's updated version should be followed. C‐OAR‐SE is leading the necessary marketing measurement revolution.

Information and communications technology (ICT) offers enormous opportunities for individuals, businesses and society. The application of ICT is equally important to economic and non-economic activities. Researchers have increasingly focused on the adoption and use of ICT by small and medium enterprises (SMEs) as the economic development of a country is largely dependent on them. Following the success of ICT utilisation in SMEs in developed countries, many developing countries are looking to utilise the potential of the technology to develop SMEs. Past studies have shown that the contribution of ICT to the performance of SMEs is not clear and certain. Thus, it is crucial to determine the effectiveness of ICT in generating firm performance since this has implications for SMEs’ expenditure on the technology. This research examines the diffusion of ICT among SMEs with respect to the typical stages from innovation adoption to post-adoption, by analysing the actual usage of ICT and value creation. The mediating effects of integration and utilisation on SME performance are also studied. Grounded in the innovation diffusion literature, institutional theory and resource-based theory, this study has developed a comprehensive integrated research model focused on the research objectives. Following a positivist research paradigm, this study employs a mixed-method research approach. A preliminary conceptual framework is developed through an extensive literature review and is refined by results from an in-depth field study. During the field study, a total of 11 SME owners or decision-makers were interviewed. The recorded interviews were transcribed and analysed using NVivo 10 to refine the model to develop the research hypotheses. The final research model is composed of 30 first-order and five higher-order constructs which involve both reflective and formative measures. Partial least squares-based structural equation modelling (PLS-SEM) is employed to test the theoretical model with a cross-sectional data set of 282 SMEs in Bangladesh. Survey data were collected using a structured questionnaire issued to SMEs selected by applying a stratified random sampling technique. The structural equation modelling utilises a two-step procedure of data analysis. Prior to estimating the structural model, the measurement model is examined for construct validity of the study variables (i.e. convergent and discriminant validity).

The estimates show cognitive evaluation as an important antecedent for expectation which is shaped primarily by the entrepreneurs’ beliefs (perception) and also influenced by the owners’ innovativeness and culture. Culture further influences expectation. The study finds that facilitating condition, environmental pressure and country readiness are important antecedents of expectation and ICT use. The results also reveal that integration and the degree of ICT utilisation significantly affect SMEs’ performance. Surprisingly, the findings do not reveal any significant impact of ICT usage on performance which apparently suggests the possibility of the ICT productivity paradox. However, the analysis finally proves the non-existence of the paradox by demonstrating the mediating role of ICT integration and degree of utilisation explain the influence of information technology (IT) usage on firm performance which is consistent with the resource-based theory. The results suggest that the use of ICT can enhance SMEs’ performance if the technology is integrated and properly utilised. SME owners or managers, interested stakeholders and policy makers may follow the study’s outcomes and focus on ICT integration and degree of utilisation with a view to attaining superior organisational performance.

This study urges concerned business enterprises and government to look at the environmental and cultural factors with a view to achieving ICT usage success in terms of enhanced firm performance. In particular, improving organisational practices and procedures by eliminating the traditional power distance inside organisations and implementing necessary rules and regulations are important actions for managing environmental and cultural uncertainties. The application of a Bengali user interface may help to ensure the productivity of ICT use by SMEs in Bangladesh. Establishing a favourable national technology infrastructure and legal environment may contribute positively to improving the overall situation. This study also suggests some changes and modifications in the country’s existing policies and strategies. The government and policy makers should undertake mass promotional programs to disseminate information about the various uses of computers and their contribution in developing better organisational performance. Organising specialised training programs for SME capacity building may succeed in attaining the motivation for SMEs to use ICT. Ensuring easy access to the technology by providing loans, grants and subsidies is important. Various stakeholders, partners and related organisations should come forward to support government policies and priorities in order to ensure the productive use of ICT among SMEs which finally will help to foster Bangladesh’s economic development.

Although there has been a great deal of interest in the idea of accounting for human resources and considerable theoretical discussion of the problems of measuring human resource value and cost, there has been virtually no empirical research on the validity of proposed methods and models. This paper reports some preliminary evidence on the validity of selected surrogates of a person's value to an organization. It describes a field study conducted to determine the convergent and discriminant validity of three possible surrogates of a person's value to an organization: replacement cost, compensation, and a performance measure.

A recent paper by Flamholtz and Wollman described the conceptualisation, development, and implementa‐tion of the stochastic rewards model for human resource valuation (SRVM) in a human capital intensive firm. An essential prerequisite before such models can actually be implemented in organisations (and used in personnel management in the ways described by Flamholtz and Wollman) is to assess the empirical validity of the numbers generated as measurements of human resource value. The purpose of the study reported in this paper, therefore, is to investigate the “convergent and discriminant validity” of the SRVM in the context of a human capital intensive firm. Our intent is to contribute to the development of human resource accounting by going beyond the theoretical justification of the previously proposed SRVM and present some empirical evidence on the validity of the numbers generated by the model.

Purpose – This chapter (a) summarizes leader–member exchange (LMX) measurement practices since the influential reviews by Schriesheim, Castro, and Cogliser (1999) and Gerstner and Day (1997), (b) clarifies the status of LMX as a broad construct from a hierarchical factor model, (c) conducts multitrait-multimethod (MTMM) analyses on leader and follower reports of multidimensional LMX, and (d) investigates discriminant validity between Member LMX and satisfaction with supervisor.

Methodology/Approach – We used (a) a literature search of LMX measurement practices, (b) a combination of meta-analysis and factor analysis to specify the broad LMX construct underlying Liden and Maslyn's (1998) (LMX-MDM) multidimensional instrument, (c) MTMM analyses of leader and member ratings of the LMX-MDM, and (d) a combination of meta-analysis and multiple regression to assess incremental validity of Member LMX beyond satisfaction with supervisor.

Findings – Since 1999, 85% of LMX studies now use one of two dominant LMX scales (LMX-7, Scandura, & Graen, 1984; LMX-MDM, Liden & Maslyn, 1998). These two measures are correlated (rcorrected=.9), suggesting the LMX-7 and the LMX-MDM are alternate forms of the same instrument. 94% of studies that used these two measures treat LMX as a single, broad construct rather than as a multidimensional set of constructs. MTMM analyses suggest Leader LMX and Member LMX are two, separate-but-related constructs (i.e., confirming two source factors and no lower-order trait factors). Last, Member LMX meta-analytically correlates with satisfaction with supervisor at rcorrected=.8. There is some incremental validity of LMX, but the pattern is inconsistent across samples.

Social Implications – We point out that LMX researchers have now moved toward standard measurement of LMX – as a broad, higher-order factor that varies between leader and follower. By doing so, we reveal that the stage is set for cumulative and replicable research on leadership as a dyadic, follower-specific phenomenon.

Originality/Value of Paper – Our chapter is the first to reveal consensus in LMX measurement across studies; to summarize the standard treatment of LMX as a single, broad factor; and to apply MTMM analyses to demonstrate separate Leader LMX and Member LMX source factors.