Search results

The current study examined several aspects of validity evidence for the Faculty Readiness to Teaching Online (FRTO) scale.

Data were collected from 307 faculty in higher education. Construct validity was evidenced through an exploratory factor analysis and a reliability coefficient. Differential validity was explored using the differential item functioning analysis to explore potential bias in items due to gender and age. In addition, convergent validity was tested by correlating FRTO with years of teaching online, the primary modality of instruction and whether there is required training in online teaching by the institution.

The findings from validation showed that new factors emerged and also demonstrated differences based on instructors gender and age, as well as based on teaching experience and primary modality of teaching.

The findings confirmed the previous study's results (Martin et al., 2019) and provided some modifications to the instrument. The factor structure did not conform to the original four factors proposed in the instrument; instead, the newly loaded factors were course design and facilitation, course technologies, course expectations and resources and time management. The revised instrument can be presented and discussed at online teaching professional development programs to help faculty understand the core competencies they need to better instruct students.

The present study aimed to validate the Indonesian-language version of the psychological capital questionnaire (PCQ), specifically within the context of higher education, by utilising Rasch analysis to evaluate the reliability and validity aspect such as item-fit statistics, rating scale function, and differential item functioning of the instrument. These questionnaires are designed to assess students' initial psychological status, aiming to ease their transition from school to university and monitor undergraduate students' mental health.

A total of 1,012 undergraduate students (female = 61.2%; male = 38.8%) from a university in Central Java, Indonesia completed the 24-item Indonesian version of the PCQ. The sampling technique used is quota sampling. Data were analysed using The Rasch model analysis, it was performed using the Winsteps 3.73 software.

The results of the Rasch analysis indicated that the reliability of the instrument was good (a = 0.80), item quality was excellent (1.00), and person reliability was consistent (0.77). In the validity aspect, all four domains of the PCQ exhibited unidimensionality, and a rating scale with four answer choices was deemed appropriate. The study also identifies item difficulty level in each dimension.

The practical implications of this study are beneficial for higher education institutions. They can use the validated Indonesian version of the PCQ to monitor the mental well-being of undergraduate students. Mapping the PsyCap can serve as a basis for developing and determining learning policies, potentially leading to improvements in student academic performance. The theoretical implications of this study are related to the advancement of measurement theory. By employing Rasch analysis, the study contributes to enhancing the validity and reliability of measurement, particularly in the context of educational and psychological assessment in Indonesia.

This current study confirmed that the Indonesian version of PCQ adequately measures psychological capital in higher education, particularly in the Indonesian context.

The research enterprise within higher education is becoming more competitive as funding agencies require more collaborative research projects, higher-level of accountability and competition for limited resources. As a result, research analytics has emerged as a field, like many other areas within higher education to act as a data-informed unit to better understand how research institutions can effectively grow their research strategy. This is a new and emerging field within higher education.

As businesses and other industries are embracing recent advances in data technologies such as cloud computing and big data analytic tools to inform decision making, research administration in higher education is seeing a potential in incorporating advanced data analytics to improve day-to-day operations and strategic advancement in institutional research. This paper documents the development of a survey measuring research administrators’ perspectives on how higher education and other research institutions perceive the use of data and analytics within the research administration functions. The survey development process started with composing a literature review on recent developments in data analytics within the research administration in the higher education domain, from which major components of data analytics in research administration were conceptualized and identified. This was followed by an item matrix mapping the evidence from literature with corresponding, newly drafted survey items. After revising the initial survey based on suggestions from a panel of subject matter experts to review, a pilot study was conducted using the revised survey instrument and validated by employing the Rasch measurement analysis.

After revising the survey based on suggestions from the subject matter experts, a pilot study was conducted using the revised survey instrument. The resultant survey instrument consists of six dimensions and 36 survey items with an establishment of reasonable item fit, item separation and reliability. This survey protocol is useful for higher educational institutions to gauge research administrators’ perceptions of the culture of data analytics use in the workplace. Suggestions for future revisions and potential use of the survey were made.

Very limited scholarly work has been published on this topic. The use of data-informed and data-driven approaches with in research strategy within higher education is an emerging field of study and practice.