Search results

With the national emphasis on the use of evidence-based practices in educational settings, intervention research within the field of special education is being scrutinized. No Child Left Behind (NCLB) has defined evidence-based practices primarily by research that is based on quantitative, experimental designs (i.e., RCT). Although the use of appropriate experimental designs has an important place in educational research, defining evidence-based practices based on research design alone is limiting. One critical aspect of research that has not received much attention is the importance of rigorous and precise measurement and systematic replication of research findings. The purpose of this chapter is to review issues surrounding measurement and its effect on validity in intervention research in the field of behavioral disorders. Specifically, we discuss how more rigorous measurement can positively influence the internal, external, construct, and social validity of research findings. A review of current trends in behavioral disorders intervention research is discussed as well as implications for future research.

In Structural Equation Modelling (SEM) cases, a number of steps to ensure that the measurement of the latent constructs, variables, and indicators have been appropriate, reliable, and meet the rules of quantitative research that must be passed by researchers. One of them is the criteria for determining the presence (or not) of a discriminant validity violation, which is still a fierce debate among researchers today. The last recommended method is the Heterotrait–Monotrait ratio of correlation (HTMT) which seeks to revise the previously existing discriminant validity criteria such as the Fornell–Larcker and Cross-loadings criteria. This chapter discusses the implementation of HTMT in the case of manufacturing small and medium enterprises (SMEs) in Indonesia with the aim of providing an illustration of how the HTMT is capable of detecting the violation of discriminant validity and the solutions that can be carried out following the recommendations given by the originators.

We develop and validate measurement instruments for the business partner, watchdog, and scorekeeper roles of controllers. This study addresses calls to enhance the quality of survey research in management accounting by devoting more attention to scale development and especially to construct validity. By focusing on the activity sets of the controllers’ roles, we provide a theoretically and empirically grounded picture of their current roles. The measurement instruments presented in this study enable systematic research progress on controller roles, their relationships, antecedents, and performance outcomes.

Information and communications technology (ICT) offers enormous opportunities for individuals, businesses and society. The application of ICT is equally important to economic and non-economic activities. Researchers have increasingly focused on the adoption and use of ICT by small and medium enterprises (SMEs) as the economic development of a country is largely dependent on them. Following the success of ICT utilisation in SMEs in developed countries, many developing countries are looking to utilise the potential of the technology to develop SMEs. Past studies have shown that the contribution of ICT to the performance of SMEs is not clear and certain. Thus, it is crucial to determine the effectiveness of ICT in generating firm performance since this has implications for SMEs’ expenditure on the technology. This research examines the diffusion of ICT among SMEs with respect to the typical stages from innovation adoption to post-adoption, by analysing the actual usage of ICT and value creation. The mediating effects of integration and utilisation on SME performance are also studied. Grounded in the innovation diffusion literature, institutional theory and resource-based theory, this study has developed a comprehensive integrated research model focused on the research objectives. Following a positivist research paradigm, this study employs a mixed-method research approach. A preliminary conceptual framework is developed through an extensive literature review and is refined by results from an in-depth field study. During the field study, a total of 11 SME owners or decision-makers were interviewed. The recorded interviews were transcribed and analysed using NVivo 10 to refine the model to develop the research hypotheses. The final research model is composed of 30 first-order and five higher-order constructs which involve both reflective and formative measures. Partial least squares-based structural equation modelling (PLS-SEM) is employed to test the theoretical model with a cross-sectional data set of 282 SMEs in Bangladesh. Survey data were collected using a structured questionnaire issued to SMEs selected by applying a stratified random sampling technique. The structural equation modelling utilises a two-step procedure of data analysis. Prior to estimating the structural model, the measurement model is examined for construct validity of the study variables (i.e. convergent and discriminant validity).

The estimates show cognitive evaluation as an important antecedent for expectation which is shaped primarily by the entrepreneurs’ beliefs (perception) and also influenced by the owners’ innovativeness and culture. Culture further influences expectation. The study finds that facilitating condition, environmental pressure and country readiness are important antecedents of expectation and ICT use. The results also reveal that integration and the degree of ICT utilisation significantly affect SMEs’ performance. Surprisingly, the findings do not reveal any significant impact of ICT usage on performance which apparently suggests the possibility of the ICT productivity paradox. However, the analysis finally proves the non-existence of the paradox by demonstrating the mediating role of ICT integration and degree of utilisation explain the influence of information technology (IT) usage on firm performance which is consistent with the resource-based theory. The results suggest that the use of ICT can enhance SMEs’ performance if the technology is integrated and properly utilised. SME owners or managers, interested stakeholders and policy makers may follow the study’s outcomes and focus on ICT integration and degree of utilisation with a view to attaining superior organisational performance.

This study urges concerned business enterprises and government to look at the environmental and cultural factors with a view to achieving ICT usage success in terms of enhanced firm performance. In particular, improving organisational practices and procedures by eliminating the traditional power distance inside organisations and implementing necessary rules and regulations are important actions for managing environmental and cultural uncertainties. The application of a Bengali user interface may help to ensure the productivity of ICT use by SMEs in Bangladesh. Establishing a favourable national technology infrastructure and legal environment may contribute positively to improving the overall situation. This study also suggests some changes and modifications in the country’s existing policies and strategies. The government and policy makers should undertake mass promotional programs to disseminate information about the various uses of computers and their contribution in developing better organisational performance. Organising specialised training programs for SME capacity building may succeed in attaining the motivation for SMEs to use ICT. Ensuring easy access to the technology by providing loans, grants and subsidies is important. Various stakeholders, partners and related organisations should come forward to support government policies and priorities in order to ensure the productive use of ICT among SMEs which finally will help to foster Bangladesh’s economic development.

This chapter, completed in 1999, provides an overview and critical analysis of the validity research agenda undertaken by the National Board for Professional Teaching Standards (NBPTS) for its assessment to certify accomplished teachers at the end of its first decade of assessment development and implementation. The review is presented in three major sections: (a) an overview of the validity criteria underlying the review; (b) a description of the National Board's research agenda presented in its own terms, focusing first on the studies that were routinely carried out for each certificate and second on the “special studies” that were not part of the routine agenda; and (c) a series of six critical observations and explanations based on the validity issues described in the first section.

Smart card-based E-payment systems are receiving increasing attention as the number of implementations is witnessed on the rise globally. Understanding of user adoption behavior of E-payment systems that employ smart card technology becomes a research area that is of particular value and interest to both IS researchers and professionals. However, research interest focuses mostly on why a smart card-based E-payment system results in a failure or how the system could have grown into a success. This signals the fact that researchers have not had much opportunity to critically review a smart card-based E-payment system that has gained wide support and overcome the hurdle of critical mass adoption. The Octopus in Hong Kong has provided a rare opportunity for investigating smart card-based E-payment system because of its unprecedented success. This research seeks to thoroughly analyze the Octopus from technology adoption behavior perspectives.

Cultural impacts on adoption behavior are one of the key areas that this research posits to investigate. Since the present research is conducted in Hong Kong where a majority of population is Chinese ethnicity and yet is westernized in a number of aspects, assuming that users in Hong Kong are characterized by eastern or western culture is less useful. Explicit cultural characteristics at individual level are tapped into here instead of applying generalization of cultural beliefs to users to more accurately reflect cultural bias. In this vein, the technology acceptance model (TAM) is adapted, extended, and tested for its applicability cross-culturally in Hong Kong on the Octopus. Four cultural dimensions developed by Hofstede are included in this study, namely uncertainty avoidance, masculinity, individualism, and Confucian Dynamism (long-term orientation), to explore their influence on usage behavior through the mediation of perceived usefulness.

TAM is also integrated with the innovation diffusion theory (IDT) to borrow two constructs in relation to innovative characteristics, namely relative advantage and compatibility, in order to enhance the explanatory power of the proposed research model. Besides, the normative accountability of the research model is strengthened by embracing two social influences, namely subjective norm and image. As the last antecedent to perceived usefulness, prior experience serves to bring in the time variation factor to allow level of prior experience to exert both direct and moderating effects on perceived usefulness.

The resulting research model is analyzed by partial least squares (PLS)-based Structural Equation Modeling (SEM) approach. The research findings reveal that all cultural dimensions demonstrate direct effect on perceived usefulness though the influence of uncertainty avoidance is found marginally significant. Other constructs on innovative characteristics and social influences are validated to be significant as hypothesized. Prior experience does indeed significantly moderate the two influences that perceived usefulness receives from relative advantage and compatibility, respectively. The research model has demonstrated convincing explanatory power and so may be employed for further studies in other contexts. In particular, cultural effects play a key role in contributing to the uniqueness of the model, enabling it to be an effective tool to help critically understand increasingly internationalized IS system development and implementation efforts. This research also suggests several practical implications in view of the findings that could better inform managerial decisions for designing, implementing, or promoting smart card-based E-payment system.

Purpose – This chapter (a) summarizes leader–member exchange (LMX) measurement practices since the influential reviews by Schriesheim, Castro, and Cogliser (1999) and Gerstner and Day (1997), (b) clarifies the status of LMX as a broad construct from a hierarchical factor model, (c) conducts multitrait-multimethod (MTMM) analyses on leader and follower reports of multidimensional LMX, and (d) investigates discriminant validity between Member LMX and satisfaction with supervisor.

Methodology/Approach – We used (a) a literature search of LMX measurement practices, (b) a combination of meta-analysis and factor analysis to specify the broad LMX construct underlying Liden and Maslyn's (1998) (LMX-MDM) multidimensional instrument, (c) MTMM analyses of leader and member ratings of the LMX-MDM, and (d) a combination of meta-analysis and multiple regression to assess incremental validity of Member LMX beyond satisfaction with supervisor.

Findings – Since 1999, 85% of LMX studies now use one of two dominant LMX scales (LMX-7, Scandura, & Graen, 1984; LMX-MDM, Liden & Maslyn, 1998). These two measures are correlated (rcorrected=.9), suggesting the LMX-7 and the LMX-MDM are alternate forms of the same instrument. 94% of studies that used these two measures treat LMX as a single, broad construct rather than as a multidimensional set of constructs. MTMM analyses suggest Leader LMX and Member LMX are two, separate-but-related constructs (i.e., confirming two source factors and no lower-order trait factors). Last, Member LMX meta-analytically correlates with satisfaction with supervisor at rcorrected=.8. There is some incremental validity of LMX, but the pattern is inconsistent across samples.

Social Implications – We point out that LMX researchers have now moved toward standard measurement of LMX – as a broad, higher-order factor that varies between leader and follower. By doing so, we reveal that the stage is set for cumulative and replicable research on leadership as a dyadic, follower-specific phenomenon.

Originality/Value of Paper – Our chapter is the first to reveal consensus in LMX measurement across studies; to summarize the standard treatment of LMX as a single, broad factor; and to apply MTMM analyses to demonstrate separate Leader LMX and Member LMX source factors.