Search results

The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada.

This research critically analyzed the scientific and theoretical bottlenecks associated with the PIE method, specifically focusing on its parameters, namely the p-value and d-index, in adherence to established statistical protocols. Proposed remedies to mitigate the identified bottlenecks and augment the efficacy of the method were grounded in practicality.

The paper provided an extensive overview of the PIE method, which served as the foundation for the subsequent analysis and discussions. This research presented potential avenues for refinement and contributed to the current debate on objective translation assessment by addressing the theoretical and practical challenges associated with the PIE method.

Translation researchers, practitioners and international institutions seeking to enhance the accuracy and reliability of translation evaluation should consider the implications of this research’s findings.

Although several publications focused on the role of the PIE method in translation evaluation, no study(ies) is available to critically analyze the scientific and theoretical bottlenecks of this translation evaluation method.

Based on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in the case of calibrated items, determine the required test length given number of respondents.

Empirical results have been obtained on computerized or multistage adaptive implementation. Simulation studies and classroom/experimental results show that adaptive tests can measure test subjects’ ability to the same quality over half the test length compared to linear versions. Due to the complexity of the problem, the authors discuss a closed mathematical formula: the relationship between the length of the tests, the difficulty of solving the items, the number of respondents and the levels of ability.

The authors present a closed formula that provides a lower bound for the minimum test length in the case of adaptive tests. The authors also present example calculations using the formula, based on the assessment framework of some student assessments to show the similarity between the theoretical calculations and the empirical results.

With this formula, we can form a connection between theoretical and simulation results.

The present study aimed to validate the Indonesian-language version of the psychological capital questionnaire (PCQ), specifically within the context of higher education, by utilising Rasch analysis to evaluate the reliability and validity aspect such as item-fit statistics, rating scale function, and differential item functioning of the instrument. These questionnaires are designed to assess students' initial psychological status, aiming to ease their transition from school to university and monitor undergraduate students' mental health.

A total of 1,012 undergraduate students (female = 61.2%; male = 38.8%) from a university in Central Java, Indonesia completed the 24-item Indonesian version of the PCQ. The sampling technique used is quota sampling. Data were analysed using The Rasch model analysis, it was performed using the Winsteps 3.73 software.

The results of the Rasch analysis indicated that the reliability of the instrument was good (a = 0.80), item quality was excellent (1.00), and person reliability was consistent (0.77). In the validity aspect, all four domains of the PCQ exhibited unidimensionality, and a rating scale with four answer choices was deemed appropriate. The study also identifies item difficulty level in each dimension.

The practical implications of this study are beneficial for higher education institutions. They can use the validated Indonesian version of the PCQ to monitor the mental well-being of undergraduate students. Mapping the PsyCap can serve as a basis for developing and determining learning policies, potentially leading to improvements in student academic performance. The theoretical implications of this study are related to the advancement of measurement theory. By employing Rasch analysis, the study contributes to enhancing the validity and reliability of measurement, particularly in the context of educational and psychological assessment in Indonesia.

This current study confirmed that the Indonesian version of PCQ adequately measures psychological capital in higher education, particularly in the Indonesian context.

The purpose of this research is to address the need for a robust system to accurately determine a cutoff score by using the Angoff method and leveraging the Rasch infit and outfit statistics of item response theory by detecting and removing misfitting items in a test.

Researchers in educational evaluation support the use of grades as a complete measure to evaluate students’ overall academic performance. In higher education, determining cutoff scores is crucial for assessing academic progress and achievement. Higher education institutions worldwide set predefined minimal standards of success, sometimes referred to as cutoff thresholds. These thresholds serve as benchmarks for assessing performance quality and determining eligibility for academic credit or advancement.

The proposed approach combines the Angoff method with Rasch item fit statistics to precisely determine the cutoff score by excluding items that do not fit well (misfitting items) in a test. This methodology holds the potential to enhance the fairness and accuracy of grading practices, ensuring that assessments align with educational objectives and provide meaningful feedback to students.

The value of this research extends to various fields where cutoff scores are used for decision-making purposes. By using Rasch item fit statistics and the Angoff method, practitioners and researchers can enhance the quality and validity of their assessments.

This study aims to evaluate Netemeyer and colleagues' much cited financial well-being scale in Brazil and India and compare responses from different demographics. It also compares the results using two analysis techniques, item response theory (IRT) and confirmatory factor analysis (CFA).

A total of 994 survey responses from Brazil and 1,081 from India were collected. IRT and CFA models were used to analyse the data.

The results demonstrate the two-dimensional structure of the financial well-being scale and show that different items are differentially useful in measuring the construct across different groups. These findings may support the scale's future refinement and use in applied studies that will target specific groups (e.g. males, females, younger respondents and older respondents).

This study serves as an example to others who can explore the advantages of IRT over classical test theory methods to assess the psychometric properties of scales aimed at measuring latent constructs of interest in the field of marketing.

The correct diagnosis of financial well-being is important to guide interventions by governments and non-governmental entities, as well as by financial institutions interested in better understanding individuals.

The authors show how the identification of the characteristics of scale items provided by the IRT technique allows for a better understanding of its properties and how it can be improved.

The importance of sustainable development has become increasingly significant in today’s fast-paced world. The 17 sustainable development goals (SDGs) aim to solve a range of environmental, economic and social challenges, which requires global collaboration among governments and private organisations. In light of this, social entrepreneurship has garnered significant attention as it combines the social purpose of non-profits with the market-driven approach of for-profits to address SDG goals. Yet the cognitive processes underpinning the career decisions of social entrepreneurs remain underexplored. This study aims to develop and validate a scale to measure social entrepreneurial career decisions based on the appraisal of perceived challenges.

The study followed the steps of tool development and was carried out in three phases: item analysis, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).

The final 20-item scale focuses on the appraisal components in pre-entry social entrepreneurial career decision-making and has four factors, which are relevance, coping potential, knowledge and resources and normative significance.

The study contributes to the literature on entrepreneurial cognition, specifically focusing on social entrepreneurship. The scale could guide model testing and quantitative research in social entrepreneurial cognition. The four-dimensional structure identified in the study may also have implications for researchers interested in the antecedents and effects of social entrepreneurial decision-making.

Accurate measurement of cognitive appraisal is necessary to understand the perceived challenges and thought processes of potential social entrepreneurs. The scale could be used to examine the cognitive appraisal patterns among students. Social entrepreneurship educators and policymakers can use the scale to design and assess educational programs.

Distinct from existing studies, this scale offers a multidimensional approach that captures the stages of career decision-making, providing a robust tool to enhance our understanding of the decision-making dynamics in social entrepreneurship.

The study examines the effectiveness of an academic integrity training program called Academic Integrity Training (AIT) in improving students’ academic integrity among final-year students.

The research design used was one group pretest and posttest (n = 40) students in research proposal courses.

Analysis with stacking and racking analysis showed a change in the distribution of the Logit Value Person (LVP) and Logit Value Item (LVI) values on the side of the subjects and items used for this study. Testing with a paired sample t-test yielded a value of t = −3.059 and a significance (p) = 0.004, indicating that there was a significant increase in LVP at the pre-test (M = 2.52 & SD = 1.56) and post-test (M = 3.33 & SD = 2.09) in the subject of the study.

The study results concluded that this academic integrity training program can improve students' academic integrity and is designed and implemented with the right personal approach to suppress academic dishonesty, especially the problem of plagiarism among graduate students submitting thesis proposals.

Academic dishonesty has been a major problem in higher education over the last two decades. Various strategies have been attempted to address the condition, but no program has been found to directly address the problem on the personal order or individuals who do so.

Post-migration stress is an important aspect of refugees’ mental health, but little is known about the relationship with insomnia. The purpose of this study was to investigate the assication between different post-migration stress factors and insomnia among Syrian refugees living in Norway.

The authors analysed survey data from the REFUGE study with 873 Syrian adults who resettled in Norway between 2015 and 2017. Potential participants were randomly selected from The Norwegian Population Register. Insomnia was measured using the Bergen Insomnia Scale. Perceived-discrimination, navigation difficulties, financial strain and loss of social status were measured via the refugee post-migration stress scale. The authors ran logistic regression analyses, controlling for socio-demographics, potentially traumatic experiences and symptoms of post-traumatic stress.

Overall, 59% (95% CI, 56%–62%) of the sample reported experiencing insomnia. In the fully-adjusted model, only financial strain and navigation difficulties were significantly associated with increased odds of insomnia. Loss of social status was also related to insomnia but only before adjusting for symptoms of post-traumatic stress.

Financial strain and navigation difficulties appear to be the most important post-migration stress factors in terms of insomnia among Syrian refugees living in Norway. Ameliorating these difficulties could potentially reduce insomnia among refugees. Since insomnia is a risk factor for the subsequent development of post-traumatic stress and depression, it is important to prevent or improve symptoms of insomnia among Syrian refugees, especially considering the high prevalence found in this study.

The research enterprise within higher education is becoming more competitive as funding agencies require more collaborative research projects, higher-level of accountability and competition for limited resources. As a result, research analytics has emerged as a field, like many other areas within higher education to act as a data-informed unit to better understand how research institutions can effectively grow their research strategy. This is a new and emerging field within higher education.

As businesses and other industries are embracing recent advances in data technologies such as cloud computing and big data analytic tools to inform decision making, research administration in higher education is seeing a potential in incorporating advanced data analytics to improve day-to-day operations and strategic advancement in institutional research. This paper documents the development of a survey measuring research administrators’ perspectives on how higher education and other research institutions perceive the use of data and analytics within the research administration functions. The survey development process started with composing a literature review on recent developments in data analytics within the research administration in the higher education domain, from which major components of data analytics in research administration were conceptualized and identified. This was followed by an item matrix mapping the evidence from literature with corresponding, newly drafted survey items. After revising the initial survey based on suggestions from a panel of subject matter experts to review, a pilot study was conducted using the revised survey instrument and validated by employing the Rasch measurement analysis.

After revising the survey based on suggestions from the subject matter experts, a pilot study was conducted using the revised survey instrument. The resultant survey instrument consists of six dimensions and 36 survey items with an establishment of reasonable item fit, item separation and reliability. This survey protocol is useful for higher educational institutions to gauge research administrators’ perceptions of the culture of data analytics use in the workplace. Suggestions for future revisions and potential use of the survey were made.

Very limited scholarly work has been published on this topic. The use of data-informed and data-driven approaches with in research strategy within higher education is an emerging field of study and practice.

Using a sample of about 323 Italian companies and 423 managers from July 2020–March 2021, the work tests hypotheses on reliability of The Open MOOd Questionnaire. Data collected are analyzed by a psychometric model and a latent trait is found. Results are verified and validated. Moreover, external robustness is assured by comparing the Rasch Analysis results with other statistical methods.

The purpose of this paper is to measure the level of openness of managers through the Open MOOd Questionnaire. Which aspects allow us to identify different management styles, and if the “openness” characterizes specific clusters of managers.

The study shows that the openness attitude in the professional activity of the managers is very high. The Open MOOd Questionnaire can be improved by considering some dichotomic items.

The study highlights the model proposed identifies the Open Manager’s competencies, and identifies teaching methods for their development.

The authors propose a new model to study openness. Diagnostic tools of consolidated statistical methods show that the Open MOOd Questionnaire is an effective tool to evaluate the openness.