Search results
11 – 20 of 706Kenneth Leithwood, Jingping Sun, Randall Schumacker and Cheng Hua
This study extends research on one of the most frequently cited school leadership frameworks by examining the psychometric properties of the instrument designed to assess many of…
Abstract
Purpose
This study extends research on one of the most frequently cited school leadership frameworks by examining the psychometric properties of the instrument designed to assess many of the practices included in that framework.
Design/methodology/approach
Using data collected from 1,401 teachers the study examined the instrument’s measurement invariance, score reliabilities, as well as construct and predictive validities. Polytomous latent trait models (Many-Facet Rasch model), scale and principal component analysis using second-order Confirmatory Factor Analysis, and Structural Equation Modeling (SEM)-Path modelling were used for these purposes.
Findings
Findings report levels of score reliability and valid score inferences. Results concerning the predictive validity of the instrument indicate a complex set of relations among the domains of leadership practices measured by the instrument, variables selected as mediators of leaders’ influence, and their direct and indirect effects on student learning.
Research limitations/implications
This study provides researchers with a reliable and valid instrument for use in their future research. Data for the study were provided by elementary teachers in one US state. The extent to which results of the instrument are valid across different cultural and organizational settings remains to be determined.
Practical implications
Leadership developers may find the instrument useful for assessing the strengths and weaknesses of those participating in their programs while leaders themselves many find the instrument useful for self-diagnosis.
Originality/value
This study contributes to the development of school leadership measures by including Rasch modeling among the methods used for examining the instrument’s psychometric properties.
Details
Keywords
Linda Koopmans, Claire Bernaards, Vincent Hildebrandt, Stef van Buuren, Allard J. van der Beek and Henrica C.W. de Vet
The purpose of the current study is to develop a generic and short questionnaire to measure work performance at the individual level – the Individual Work Performance…
Abstract
Purpose
The purpose of the current study is to develop a generic and short questionnaire to measure work performance at the individual level – the Individual Work Performance Questionnaire (IWPQ). The IWPQ was based on a four‐dimensional conceptual framework, in which individual work performance consisted of task performance, contextual performance, adaptive performance, and counterproductive work behavior.
Design/methodology/approach
After pilot‐testing, the 47‐item IWPQ was field‐tested amongst a representative sample of 1,181 Dutch blue, pink, and white collar workers. Factor analysis was used to examine whether the four‐dimensional conceptual framework could be confirmed. Rasch analysis was used to examine the functioning of the items in more detail. Finally, it was examined whether generic scales could be constructed.
Findings
A generic, three‐dimensional conceptual framework was identified, in which individual work performance consisted of task performance, contextual performance, and counterproductive work behavior. Generic, short scales could be constructed that fitted the Rasch model.
Research limitations/implications
A generic, short questionnaire can be used to measure individual work performance across occupational sectors. In future versions of the IWPQ, more difficult items should be added to improve discriminative ability at the high ranges of the scale.
Originality/value
This study shows that, using Rasch analysis, a generic and short questionnaire can be used to measure individual work performance.
Details
Keywords
Christoph Emanuel Mueller and Silke Inga Keil
Governments and energy operators are often confronted with opposition to the construction of new high-voltage transmission lines. Besides other factors, a potential determinant of…
Abstract
Purpose
Governments and energy operators are often confronted with opposition to the construction of new high-voltage transmission lines. Besides other factors, a potential determinant of public opposition and acceptance that has gained increasing attention is the fairness of the planning and approval procedure as perceived by the citizens. The purpose of this study is to develop and validate a scale for measuring perceived procedural fairness (PPF).
Design/methodology/approach
The authors developed the ten-item “perceived procedural fairness scale (PPFS)” and assessed its quality by means of item response theory. By using a Rasch rating scale model, the authors tested whether the instrument met the requirements of this kind of measurement model. For conducting their research, the authors used data from two telephone surveys in Germany that were collected in areas that are affected by grid expansion.
Findings
The findings suggest that the scale can be considered a reliable and internal valid instrument for measuring citizens’ PPF.
Originality/value
At the moment, there is no psychometrically rigorously evaluated scale available for measuring PPF in the context of power grid expansion. Therefore, the study contributes to filling this gap and provides a valuable tool for researchers and practitioners concerned with further investigating citizens’ PPF and its relationships with other relevant constructs in the field.
Details
Keywords
Budi Setiawan, Morita Panduwangi and Bambang Sumintono
The purpose of this paper is to investigate the degree to which the different attributes of Islamic banks in Indonesia are preferred by the community.
Abstract
Purpose
The purpose of this paper is to investigate the degree to which the different attributes of Islamic banks in Indonesia are preferred by the community.
Design/methodology/approach
This paper uses a quantitative approach by applying Rasch analysis to measure the relative importance of 18 attributes of Islamic banks to the community. The data were collected by questionnaires, which were distributed online and completed by 345 respondents. In addition to the Rasch model, the preference of attributes was measured by a statistical inference test, using “SPSS” software, which employs binary logic regression related to the agreement between the performance of attributes and expectations.
Findings
The instrument used in this study showed good reliability, and its validity fits the expected model. The results show that the assurance of financial security, friendliness and the application of Islamic principles in their operations are the most important attributes to be considered when people choose an Islamic bank. The degree of importance placed by the community on the various attributes of Islamic banks will have an effect upon the actual and perceived quality of those attributes. An increase in the community’s preference for a particular attribute will eventually be followed by an increased agreement between the actual performance of that attribute and the community’s expectation.
Research limitations/implications
The varied profiles of individual respondents were not explored fully: this research relies solely on quantitative analysis. So, there is no empirical information to inform the Islamic banks as to which segments of the community should be the focus of their promotional activities.
Originality/value
The use of Rasch analysis to measure the community’s preference for various attributes of Islamic banks has not been done previously.
Details
Keywords
Gives direction as to how administrative quality at a university can be measured on an interval scale. The measure is based on a model of academic staff perceptions in relation to…
Abstract
Gives direction as to how administrative quality at a university can be measured on an interval scale. The measure is based on a model of academic staff perceptions in relation to central, faculty or school administration (as the case may be). The Australian Government set up a new Australian University Quality Agency in 2001 and one of its objectives is to measure quality in administration (management). Proposes that academic staff perceptions of administrative quality consist of two first order aspects, operationally defined by a number of second order aspects. The 21 stem‐items measuring each second order aspect are set up in Guttman patterns, conceptually ordered by increasing “difficulty”. Academics are asked to respond to each of the 21 stem‐items in two parts, conceptually ordered from “easy” to “hard”. This model has been pilot tested successfully with a small sample (N = 27) and is now ready for a full test.
Details
Keywords
Allaa Barefah, Elspeth McKay and Sulaiman Alqahtani
There is continual evidence of ineffective e-Learning programmes that are set amid emerging information and communication technology (ICT) tools by higher education (HE…
Abstract
There is continual evidence of ineffective e-Learning programmes that are set amid emerging information and communication technology (ICT) tools by higher education (HE) providers. While many of the existing accounts outline the potential of integrating such educational technology into their teaching and learning practice, other studies point out the adoption challenges of such programmes. This chapter tackles this dilemma in two respects. Firstly, through an examination of the limitations surrounding the instructional systems design (ISD) models while urging the need for empirical evidence and ratification processes to substantiate these models as they relate to online instructional environments. Secondly, through the investigation of the effectiveness offered by ICT tools under different instructional environments in order to facilitate the effective application of e-Learning. Field evaluation in the form of a series of 2×3 factorial quasi-experiments was conducted at four higher education institutions in Saudi Arabia. The empirical results confirm the validity of the ISD model and reliably captured its effects in improving learners’ performance under three instructional delivery modes. The empirical evidence reveals the extent of effectiveness of the proposed prescriptive ISD model enabling an improved design of ICT-based HE instructional strategies. On a managerial level, the findings facilitate the delivery mode decision making by HE providers in terms of the congruence of technology integration under each of the three learning experiences. The calibrated assessment measures provide a discussion to extend the practical implication of the current e-Pedagogical practice in the e-Learning industry.
Details
Keywords
Chin Mun Wong, Mohd Rohaizat Hassan, Rozita Hod, Sharifa Ezat Wan Puteh and Sazaly Abu Bakar
This study aims to validate the English version of a WHO-adapted questionnaire: Zika infection awareness/knowledge questionnaire using a unique dual-approach validation model.
Abstract
Purpose
This study aims to validate the English version of a WHO-adapted questionnaire: Zika infection awareness/knowledge questionnaire using a unique dual-approach validation model.
Design/methodology/approach
A cross-sectional pilot study of 30 adult respondents in Malaysia completed the self-administered questionnaire on knowledge and perception to Zika infection. Construct validity was assessed by exploratory factor analysis (EFA) of SPSS and Rasch partial credit. Reliability is tested using pKR20 and Cronbach’s alpha.
Findings
Knowledge construct was unidimensional, good model fit, easy to endorse and well discriminative. Five-rating Likert scale for perception domain was appropriate. Knowledge domain should be separated into 6 level of difficulties. Perception domain should remain as one construct. Knowledge domain was highly reliability (pKR20 = 0.96), perception domain was fairly reliable (Cronbach’s alpha = 0.641). Respondent's ability to answer knowledge domain and perception domain were separated into 3 and 4 levels.
Research limitations/implications
Small sample size may affect factor analysis.
Practical implications
The questionnaire has good psychometric properties to measure the knowledge and perception of Zika infection among Malaysian community.
Social implications
The questionnaire helped to gauge knowledge and perception of the general community in Malaysia to aid preparation of health education tool for Zika infection.
Originality/value
This paper validated questionnaire with two biostatistical software programs in bidirectional approach – items difficulty and respondents' ability – is the first field test of WHO questionnaire among general population in Southeast Asia.
Details
Keywords
Vanessa Yanes‐Estévez, Juan Ramón Oreja‐Rodríguez and Ana Maria García‐Pérez
The paper's aim is to develop a diagnosis of the environment of the agrifood supply chain based on members' perceptions of environmental uncertainty.
Abstract
Purpose
The paper's aim is to develop a diagnosis of the environment of the agrifood supply chain based on members' perceptions of environmental uncertainty.
Design/methodology/approach
Environmental uncertainty is defined as the lack of information about the external environment and is obtained by integrating the perceived dynamism and complexity of the environmental variables. The measurements that are used are the result of applying the Rasch methodology to the information obtained by means of a questionnaire completed by the deciders of firms in the Canary Islands (Spain). Those measures permit the complexity and dynamism perceived by the groups of firms in the supply chain together with the levels of perceived dynamism and complexity of the environmental variables to be jointly positioned on a map.
Findings
According to the perceptions of the members of the agrifood supply chain (agriculture, agrifood industry and distribution), the main sources of environmental uncertainty are demand and competitors. The agricultural sector perceives somewhat more uncertainty than agrifood industry sector, while the distribution sector perceives a stable environment.
Research limitations/implications
The paper presents a useful tool for the business population and public institutions to identify which variables are perceived as the most dynamic and complex and how those variables are perceived by each member of the agrifood supply chain.
Originality/value
The paper operationalises the proposal of Duncan by means of a new application of the Rasch methodology. The results reflect the thinking of the members of all sectors of a supply chain. It is one of the first to study the environmental uncertainty perceived in the agrifood supply chain from a strategic perspective as a fundamental antecedent of the promotion of vertical collaboration in the agrifood supply chain.
Details
Keywords
Ana María García-Pérez, Vanessa Yanes-Estévez, Juan Ramón Oreja-Rodríguez and Enrique González-Dávila
– The purpose of this paper is to study the strategic process of small- and medium-sized enterprises (SMEs) including strategic reference points (SRP) (Fiegenbaum et al., 1996).
Abstract
Purpose
The purpose of this paper is to study the strategic process of small- and medium-sized enterprises (SMEs) including strategic reference points (SRP) (Fiegenbaum et al., 1996).
Design/methodology/approach
The paper identifies the strategic positioning of SMEs (Lavie and Fiegenbaum, 2000, 2003) according to the importance that their managers give to internal and external SRP. Their influence on strategic types (Miles and Snow, 1978) and performance are analysed. This study uses information, from 83 SMEs in the Canary Islands (Spain), collected with a questionnaire.
Findings
SMEs are primarily adaptive firms followed by narcissist ones: numerous SMEs focus their attention on internal SRPs. SMEs strategic positioning determines their strategic orientations to a much lesser extent than their characteristics (sector, size and age) do. The results show that product specialisation, the only difference between adaptive SMEs and narcissist and amorphous ones, is not evident in their performance.
Practical implications
Decision makers and institutions should reflect about the maturity of the strategic process and the adaptation dynamic of SMEs. The need for SMEs to focus on their external vision should be highlighted.
Originality/value
The study includes SRP in the strategic process of SMEs. It contributes to the literature by drawing a map of the strategic positioning of SMEs, based on their SRPs (Lavie and Fiegenbaum (2000, 2003) and by linking the strategic positioning of SMEs with their strategic types. It also has the value of applying the Rasch Rating Scale Model (Andrich, 1978, 1988).
Details
Keywords
John Ehrich, Steven Howard, James Tognolini and Sahar Bokosmaty
The purpose of this paper is to address the issue of failing to psychometrically test questionnaire instruments when measuring university students’ attitudes towards plagiarism…
Abstract
Purpose
The purpose of this paper is to address the issue of failing to psychometrically test questionnaire instruments when measuring university students’ attitudes towards plagiarism. These issues are highlighted by a psychometric evaluation of a commonly used (but previously untested) plagiarism attitudinal scale.
Design/methodology/approach
The importance of psychometric testing is shown through an analysis of a commonly used scale using modern techniques (e.g. Rasch analysis) on 131 undergraduate education students at an Australian university.
Findings
Psychometric analysis revealed the scale to be unreliable in its present form. However, when reduced to an eight-item subscale it became marginally reliable.
Research limitations/implications
The main implication of this paper is that questionnaire instruments cannot be assumed to function as they are intended without thorough psychometric testing.
Practical implications
The paper offers valuable insight into the psychometric properties of a previously untested but commonly used plagiarism attitudinal scale.
Originality/value
The paper offers a straightforward and easy to understand introduction to researchers in higher education who use questionnaires/surveys in their research but lack an understanding of why psychometric testing is so critical. While similar papers have been written in other fields which advocate psychometric approaches, such as Rasch analysis, this has not been the case in higher educational research (or mainstream educational research for that matter).
Details