Search results

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.

This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.

Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.

One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.

At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.

So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.

Current assessment models in education have focused solely on measuring knowledge and fail to address the goals of Sustainable Development Goal 4 (SDG4) for a well-rounded, future-proof education. While SDG4 emphasizes quality education, traditional assessments do not account for the diverse skills and intelligence learners possess. This gap between assessment and the needs of SDG4 presents a conundrum for educators: How can we develop assessment strategies that encompass multiple intelligences and prepare learners for the future while ensuring the delivery of quality education as outlined by SDG4? This paper aims to propose integrated assessment strategies as a solution, examining their effectiveness in assessing multiple intelligences and supporting the future-proofing agenda within quality education.

The study used a qualitative research design. Interviews were held up to saturation point with 60 teachers and students purposively selected from schools in ten provinces across the country. Data from interviews were analysed using thematic network analysis. The data were complemented by documentary analysis from the Ministry of Primary and Secondary Education, Zimbabwe documents which included Curriculum Frameworks and policy documents as well as a systematic literature review.

Results indicated that integrated assessment systems provide an avenue for testing deeper learning and help students acquire competencies needed in the world of work, such as problem-solving and teamwork. However, certain conditions mitigate against the effective implementation of integrated assessment in schools.

This study uses the use of a qualitative research methodology, hence the generalizability of results in other settings may not be possible. The data collected from the research findings was manually coded and analysed. However, coding the data manually allowed the researchers to be fully immersed in the emerging themes enriching the study with additional data. This means that in-depth data engagement was ensured.

The paper concludes that integrated assessment provides authentic assessment which prepares learners for the future. The study recommends that the government should redress the teaching-learning environment in schools for effective implementation of integrated assessment systems so that not only one regime of intelligence is tested and future-proofing of quality is guaranteed.

The research contributes to increasing the motivation to deliver quality education by investing in integrated evaluation systems.

This paper aims to identify and evaluate resolutions to key learning and teaching challenges in very large courses that involve practical mathematics, such as foundational finance.

A design-based research approach is used across three semesters to iteratively identify practical problems within the course and then develop and evaluate resolutions to these problems. Data are collected from both students and teachers and analysed using a mixed-method approach.

The results indicate that key learning and teaching challenges in large foundational finance courses can be mitigated through appropriate consistency of learning materials; check-your-understanding interactive online content targeting foundational concepts in the early weeks; connection points between students and the coordinator to increase teacher presence; a sustained focus on supporting student achievement within assessments; and signposting relevance of content for the broader program and professional settings. Multiple design iterations using a co-design approach were beneficial to incrementally improve the course and consider multiple perspectives within the design process.

This paper develops a set of design principles to provide guidance to other practitioners who seek to improve their own courses.

The use of design-based research and mixed-method approaches that consider both student and teacher perspectives to examine the design of very large, foundational finance courses is novel.

In November 2022, the commercial company, OpenAI, launched ChatGPT. Since then, university students have rapidly become regular users of this artificial intelligence (AI) platform. One reason for this is the powerful capability of this generative AI tool to produce textual content, which in many cases, is almost indistinguishable from human-generated content. Another reason is that ChatGPT easily gives anyone access to knowledge. However, there is a problem as the vast majority of its users have no idea how this AI platform works and thus overlook the importance of thinking critically about information communicated in ChatGPT. While some call for banning this generative AI tool, this study aims to provide evidence that science classrooms can become scenarios where students find explicit, concrete, and realistic opportunities to critically evaluate scientific information generated by ChatGPT.

An intervention study was conducted with 55 students (26 females and 29 males, 17–24 years old) during a university Spanish-English bilingual science course taught within an active learning environment. The data consist of the written critiques of the students about Spanish-English bilingual scientific texts produced by ChatGPT.

Results indicate that the intervention had a positive effect on students’ abilities to construct sound arguments in Spanish and in English while judging the quality of scientific texts produced by this AI bot. Moreover, the findings suggest that the intervention enriched students’ skills to make improvements to texts produced by this generative AI tool.

The evidence provided in this study contributes to the exploration of possibilities to help students become critical users of ChatGPT.

Research serves to elucidate and tackle real-world issues (e.g. capitalizing opportunities and solving problems). Critical to research is the concept of validity, which gauges the extent to which research is adequate and appropriate in representing what it intends to measure and test. In this vein, this article aims to present a typology of validity to aid researchers in this endeavor.

Employing a synthesis approach informed by the 3Es of expertise, experience, and exposure, this article maintains a sharp focus on delineating the concept of validity and presenting its typology.

This article emphasizes the importance of validity and explains how and when different types of validity can be established. First and foremost, content validity and face validity are prerequisites assessed before data collection, whereas convergent validity and discriminant validity come into play during the evaluation of the measurement model post-data collection, while nomological validity and predictive validity are crucial in the evaluation of the structural model following the evaluation of the measurement model. Additionally, content, face, convergent and discriminant validity contribute to construct validity as they pertain to concept(s), while nomological and predictive validity contribute to criterion validity as they relate to relationship(s). Last but not least, content and face validity are established by humans, thereby contributing to the assessment of substantive significance, whereas convergent, discriminant, nomological and predictive validity are established by statistics, thereby contributing to the assessment of statistical significance.

This article contributes to a deeper understanding of validity’s multifaceted nature in research, providing a practical guide for its application across various research stages.

Large class sizes are becoming the norm in higher education against concerns of dropping learning qualities. To maintain the standard of learning and add value, one of the common strategies is for the course convenor to proactively monitor student engagement with learning activities against their assessment outcomes and intervene timely. Learning analytics has been increasingly adopted to provide these insights into student engagement and their performance. This case study explores how learning analytics can be used to meet the convenor’s requirements and help reduce administrative workload in a large health science class at the University of New South Wales.

This case-based study adopts an “action learning research approach” in assessing ways of using learning analytics for reducing workload in the educator’s own context and critically reflecting on experiences for improvements. This approach emphasises reflexive methodology, where the educator constantly assesses the context, implements an intervention and reflects on the process for in-time adjustments, improvements and future development.

The results highlighted ease for the teacher towards the early “flagging” of students who may not be active within the learning management system or who have performed poorly on assessment tasks. Coupled with the ability to send emails to the “flagged” students, this has led to a more personal approach while reducing the number of steps normally required. An unanticipated outcome was the potential for additional time saving through improving the scaffolding mechanisms if the learning analytics were customisable for individual courses.

The results provide further benefits for learning analytics to assist the educator in a growing blended learning environment. They also reveal the potential for learning analytics to be an effective adjunct towards promoting personal learning design.

The purpose of this study is to address the mixed predictions about the relationship between general skills training and turnover intention of early career graduates by examining the mediating mechanisms of perceived organizational support (POS) and job satisfaction (JS) through which this relationship might be enacted. This study adopts organizational support theory as the guiding theory and examines the concept of POS as critical for predicting and explaining relationships in the conceptual framework.

A quantitative survey method was used on a sample of 147 Chinese early career graduate trainees. Analysis was conducted using partial least square-based structural equation modelling (PLS-SEM).

The main finding is that participation in general skills training (PGST) does not directly impact turnover intention, rather POS is a mechanism through which this negative relationship operates. This study also found significant evidence for serial mediation by POS on PGST and its relationship with turnover intention. Importantly, JS only has an effect on turnover intention when in the presence of serial mediation by POS.

Cross-sectional study of a small survey sample. Nonetheless, the findings have major implications for research theories on the relationship of general skills training with employee turnover.

PGST does not directly impact turnover intention, rather POS is a mechanism through which this negative relationship operates.

This research emphasizes the important role of POS in the relationship between early career graduate trainees’ PGST and their turnover intentions.

This study examines the impact of career competencies (CC) (in the form of personal resources) on sustainable employability (SE) under the tenets of the Conservation of Resources theory. Further, we assess the moderating impact of coworker support and supervisor support (work-related social resources) in this relationship.

Data were collected using survey method from 362 doctors employed in private hospitals in Pakistan. The data were analyzed using structural equation modeling (SEM).

The results suggests a significant influence of CC on SE. Further, results also reveal that social support received from coworkers moderates the relationship between CC and SE. However, we find that supervisor support does not moderate the said relationship.

This research has clear novelty as SE is a recently defined construct and is still an area with insufficient empirical research. There is increasing interest in identifying the determinants and underlying mechanism of SE. Thus, this study makes contributions to knowledge by investigating CC and social resources as antecedents of SE. This study also offers implications for theory generally, and within the medical practitioner context more specifically.