Search results

This article investigates the application of generative artificial intelligence (GenAI) in experiential learning for authentic assessment in higher education. Recognized for its human-like content generation, GenAI has garnered widespread interest, raising concerns regarding its reliability, ethical considerations and overall impact. The purpose of this study is to explore the transformative capabilities and limitations of GenAI for experiential learning.

The study uses “thing ethnography” and “incremental prompting” to delve into the perspectives of ChatGPT 3.5, a prominent GenAI model. Through semi-structured interviews, the research prompts ChatGPT 3.5 on critical aspects such as conceptual clarity, integration of GenAI in educational settings and practical applications within the context of authentic assessment. The design examines GenAI’s potential contributions to reflective thinking, hands-on learning and genuine assessments, emphasizing the importance of responsible use.

The findings underscore GenAI’s potential to enhance experiential learning in higher education. Specifically, the research highlights GenAI’s capacity to contribute to reflective thinking, hands-on learning experiences and the facilitation of genuine assessments. Notably, the study emphasizes the significance of responsible use in harnessing the capabilities of GenAI for educational purposes.

This research showcases the application of GenAI in operations management education, specifically within lean health care. The study offers insights into its capabilities by exploring the practical implications of GenAI in a specific educational domain through thing ethnography and incremental prompting. Additionally, the article proposes future research directions, contributing to the originality of the work and opening avenues for further exploration in the integration of GenAI in education.

In order to solve the problem of inaccurate calculation of index weights, subjectivity and uncertainty of index assessment in the risk assessment process, this study aims to propose a scientific and reasonable centralized traffic control (CTC) system risk assessment method.

First, system-theoretic process analysis (STPA) is used to conduct risk analysis on the CTC system and constructs risk assessment indexes based on this analysis. Then, to enhance the accuracy of weight calculation, the fuzzy analytical hierarchy process (FAHP), fuzzy decision-making trial and evaluation laboratory (FDEMATEL) and entropy weight method are employed to calculate the subjective weight, relative weight and objective weight of each index. These three types of weights are combined using game theory to obtain the combined weight for each index. To reduce subjectivity and uncertainty in the assessment process, the backward cloud generator method is utilized to obtain the numerical character (NC) of the cloud model for each index. The NCs of the indexes are then weighted to derive the comprehensive cloud for risk assessment of the CTC system. This cloud model is used to obtain the CTC system's comprehensive risk assessment. The model's similarity measurement method gauges the likeness between the comprehensive risk assessment cloud and the risk standard cloud. Finally, this process yields the risk assessment results for the CTC system.

The cloud model can handle the subjectivity and fuzziness in the risk assessment process well. The cloud model-based risk assessment method was applied to the CTC system risk assessment of a railway group and achieved good results.

This study provides a cloud model-based method for risk assessment of CTC systems, which accurately calculates the weight of risk indexes and uses cloud models to reduce uncertainty and subjectivity in the assessment, achieving effective risk assessment of CTC systems. It can provide a reference and theoretical basis for risk management of the CTC system.

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.

This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.

Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.

One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.

At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.

So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.

The purpose of this study is to generate knowledge about assessment methods in blended business education, which have become increasingly important to establish sustainable assessment practices that support knowledge acquisition for undergraduate students in business administration at a Colombian university.

For the analysis, a two groups comparison was performed using a nonequivalent control group design with a sample of 420 students. As this study wants to find insights to improve the knowledge on assessment topics in marketing research (MR) education, it was focused on the students from the business administration program. This study also uses individual scores from the state test as prior cognitive scores and the high school classification provided by the National Ministry of Education in Colombia (2012).

It was found that the variables that best predict performance on the MR course examinations were the mathematics skills and reading comprehension scores on the state test. The study also showed a better performance of female students on both assessment methods. There were no significant differences between the assessment methods or among the high school levels.

One of the limitations of this study is the limited number of items on the tests. Additionally, the authors recommend conducting an analysis of the differences between the testing items to provide a detailed explanation of students’ performance when comparing computer-based testing and paper-and-pencil testing.

Further design of teaching material and assessments online and offline, based on local and regional marketing problems, is suggested. As the current text and readings are more oriented to the English-speaking contexts, most of the problems presented are oriented to multinational companies and brands.

Insights into the skills required for future jobs provide valuable guidance (World Economic Forum, 2020). Essential skills for emerging roles, like data scientists, can find robust support within the MR course. To further enrich in-class and online exercises with Excel and SPSS, Colombian educators can leverage data sets obtained from sources like the national statistics office and international market intelligence databases available through the university’s library, including Passport and Statista. Engaging with authentic data sets provides students with a more profound understanding of practical applications in MR.

This approach facilitates the identification of key variables, such as assessment and cognitive abilities in math and reading, which predict students’ knowledge acquisition in MR. It not only offers insights into the relevant factors influencing learning in MR but also provides valuable feedback. Additionally, it suggests potential avenues for future research in this field.

The purpose of this paper is to describe this new evaluation experience with portfolio in economics, not only from the teacher’s point of view but from the student perspective, and all the learning from its implementation; to provide ideas of evaluation practices in virtual and face-to-face modality in international business education; to motivate the rethinking of assessment practices in higher education to combine the best of each modality in the future.

The present work is a case study based on a qualitative description of the implementation of a portfolio as an assessment practice, supported by a reflection questionnaire with students’ perceptions and some elements of metacognition. The first section summarizes the literature used as a theoretical framework of this work. The second section describes the portfolio implementation by analyzing teachers and students reflections with a qualitative approach. The third section presents the findings. The fourth section is a discussion of findings, practical implications, limitations and future research directions. Finally, the conclusions of the work are shared.

Because the portfolio has had overwhelming results to assess what students have learned during the pandemic, it has become the learning and assessment tool after the pandemic, as it transforms the classes experience by shifting the focus from traditional examinations to more comprehensive, personalized and reflective ones. It also empowers students to take ownership of their learning, develop essential skills and cultivate a deeper understanding. Among other benefits, the portfolio means the creation of a safe and supportive environment for honest reflection, the development and design of strategic directions to improve learning and lead students toward metacognitive autonomy. Reflection pieces, a critical component of the portfolio, are a vital tool in the proactive learning process, as through reflection students learn to examine their own performance and discuss strategies to enhance their success in future work.

This work began as an educational experience per se, not for research purposes, which caused it to be systematized and reconstructed in a descriptive way, not to measure quantitative results. In this way, the present work describes that the portfolio helps to achieve better results on students’ learning than traditional examinations but, as another limitation, it does not measure them nor the process. One more limitation of this work is that it was written in a postpandemic context but was implemented during the pandemic; therefore, the circumstances of writing are not the same as those of implementation, and this could also entail a certain margin of decontextualization. At the same time, this is an experience that is still in process and continually being adapted to this changed and changing educational postpandemic context.

One of the main implications of the portfolio experience, transferable to all educational contexts, is that it transforms the final exam into a metacognitive one, letting students be aware of their own process of learning and results – objectives and competences – acquired. In this way, it lets teachers witness a part of the learning process that is not so evident in the traditional assessment practices – focused on some aspect of the learning – as it makes visible the way in which students receive, process and apply content, that is to say, how they make it their own.

The portfolio promotes reflective learning and metacognition, vital skills that benefit students beyond the classroom. This can have a positive impact on societal attitudes toward education and the quality of learning. Of the students, 82% felt the portfolio creation was helpful in their personal and professional lives, suggesting a broader societal impact. The paper’s findings contribute to the body of knowledge about the effectiveness of portfolio-based assessment in higher education, especially in the worldwide transition from online education to postpandemic education. This could guide future studies in similar educational contexts or with different pedagogical innovative tools.

In light of the 2020 pandemic lockdown, this work delves into the pressing need for educators to adapt and modify their teaching approaches. The relevance of this study is accentuated by the worldwide transition from online education to postpandemic education. This paper bridges the gap between theory and practice because the research can be applied to the educational practice of any international business education context, as well as lay the foundations for future research in the field that contributes to increasing evidence of the effectiveness of the use of the portfolio to achieve significant and deep learning in higher education.

In academia, assessment is often narrow in its focus on research productivity, its application of a limited number of standardised metrics and its summative approach aimed at selection. This approach, corresponding to an exclusive, subject-oriented concept of talent management, can be thought of as at odds with a broader view of the role of academic institutions as accelerating and improving science and scholarship and its societal impact. In recent years, open science practices as well as research integrity issues have increased awareness of the need for a more inclusive approach to assessment and talent management in academia, broadening assessment to reward the full spectrum of academic activities and, within that spectrum, deepening assessment by critically reflecting on the processes and indicators involved (both qualitative and quantitative). In terms of talent management, this would mean a move from research-focused assessment to assessment including all academic activities (including education, professional performance and leadership), a shift from focus on the individual to a focus on collaboration in teams (recognising contributions of both academic and support staff), increased attention for formative assessment and greater agency for those being evaluated, as well as around the data, tools and platforms used in assessment. Together, this represents a more inclusive, subject-oriented approach to talent management. Implementation of such changes requires involvement from university management, human resource management and academic and support staff at all career levels, and universities would benefit from participation in mutual learning initiatives currently taking shape in various regions of the world.

Identifying and prioritizing supply chain risk is significant from any product’s quality and reliability perspective. Under an input-process-output workflow, conventional risk prioritization uses a risk priority number (RPN) aligned to the risk analysis. Imprecise information coupled with a lack of dealing with hesitancy margins enlarges the scope, leading to improper assessment of risks. This significantly affects monitoring quality and performance. Against the backdrop, a methodology that identifies and prioritizes the operational supply chain risk factors signifies better risk assessment.

The study proposes a multi-criteria model for risk prioritization involving multiple decision-makers (DMs). The methodology offers a robust, hybrid system based on the Intuitionistic Fuzzy (IF) Set merged with the “Technique for Order Performance by Similarity to Ideal Solution.” The nature of the model is robust. The same is shown by applying fuzzy concepts under multi-criteria decision-making (MCDM) to prioritize the identified business risks for better assessment.

The proposed IF Technique for Order Preference by Similarity to the Ideal Solution (TOPSIS) for risk prioritization model can improve the decisions within organizations that make up the chains, thus guaranteeing a “better quality in risk management.” Establishing an efficient representation of uncertain information related to traditional failure mode and effects analysis (FMEA) treatment involving multiple DMs means identifying potential risks in advance and providing better supply chain control.

In a company’s supply chain, blockchain allows data storage and transparent transmission of flows with traceability, privacy, security and transparency (Roy et al., 2022). They asserted that blockchain technology has great potential for traceability. Since risk assessment in supply chain operations can be treated as a traceability problem, further research is needed to use blockchain technologies. Lastly, issues like risk will be better assessed if predicted well; further research demands the suitability of applying predictive analysis on risk.

The study proposes a hybrid framework based on the generic risk assessment and MCDM methodologies under a fuzzy environment system. By this, the authors try to address the supply chain risk assessment and mitigation framework better than the conventional one. To the best of their knowledge, no study is found in existing literature attempting to explore the efficacy of the proposed hybrid approach over the traditional RPN system in prime sectors like steel (with production planning data). The validation experiment indicates the effectiveness of the results obtained from the proposed IF TOPSIS Approach to Risk Prioritization methodology is more practical and resembles the actual scenario compared to those obtained using the traditional RPN system (Kim et al., 2018; Kumar et al., 2018).

This study provides mathematical models to simulate the supply chain risk assessment, thus helping the manufacturer rank the risk level. In the end, the authors apply this model in a big-sized organization to validate its accuracy. The authors validate the proposed approach to an integrated steel plant impacting the production planning process. The model’s outcome substantially adds value to the current risk assessment and prioritization, significantly affecting better risk management quality.

This paper aims to understand the clinical practice of physiotherapists and occupational therapists in the Republic of Ireland in the assessment and treatment of spasticity in adults, to inform and improve spasticity management practice. This study also aims to describe therapists’ knowledge, confidence and perceived barriers in the management of spasticity.

A cross sectional survey design study was completed, and respondents were recruited through an online survey.

In total, 92 respondents from a wide range of clinical settings revealed there is considerable variation in services available nationally for adults presenting with spasticity. There were significant inconsistencies across all areas of practice. The majority of respondents (94%) did provide intervention to patients with spasticity, yet three quarters did not have access to a specialist spasticity clinic, and the majority (82%) did not feel they were providing sufficient treatment intensity for spasticity.

These findings provide a unique insight into the assessment and treatment practices of Irish physiotherapists and occupational therapists. These results demonstrate the need for further upskilling and specialist high-quality spasticity services nationally.

To elaborate the nature of fact-checking in the domain of political information by examining how fact-checkers assess the validity of claims concerning the Russo-Ukrainian conflict and how they support their assessments by drawing on evidence acquired from diverse sources of information.

Descriptive quantitative and qualitative content analysis of 128 reports written by the fact-checkers of Snopes – an established fact-checking organisation – during the period of 24 February 2022 – 28 June, 2023. For the analysis, nine evaluation grounds were identified, most of them inductively from the empirical material. It was examined how the fact-checkers employed such grounds while assessing the validity of claims and how the assessments were bolstered by evidence acquired from information sources such as newspapers.

Of the 128 reports, the share of assessments indicative of the invalidity of the claims was 54.7%, while the share of positive ratings was 26.7%. The share of mixed assessments was 15.6%. In the fact-checking, two evaluation grounds, that is, the correctness of information and verifiability of an event presented in a claim formed the basis for the assessment. Depending on the topic of the claim, grounds such as temporal and spatial compatibility, as well as comparison by similarity and difference occupied a central role. Most popular sources of information offering evidence for the assessments include statements of government representatives, videos and photographs shared in social media, newspapers and television programmes.

As the study concentrated on fact-checking dealing with political information about a specific issue, the findings cannot be extended to concern the fact-checking practices in other contexts.

The study is among the first to characterise how fact-checkers employ evaluation grounds of diverse kind while assessing the validity of political information.

Improving buildability of building designs with the aid of buildability assessment is essential because of the effect of designs on construction. Despite the plethora of research into buildability reported over the years, a review of the literature shown a dearth of research into the factors supporting the implementation of buildability assessment. Because buildability assessment has been confirmed to be highly beneficial to construction business, this study aims to investigate the factors supporting the implementation of buildability assessment as a tool for buildability improvement using Nigeria as a representative case.

Survey research method was adopted for the study. Questionnaires were administered to a purposively selected group of architects, engineers, builders and quantity surveyors involved in construction project delivery within client, consulting and contracting organisations in Nigeria. A total of 368 questionnaires were distributed among the sampled participants, out of which, a total of 219 representing 60% were sufficiently filled and returned. Data collected were analysed using inferential and descriptive statistics.

The results revealed owner’s commitment, clients’ awareness of the benefits of conducting buildability assessment on building design, unity amongst different professionals in the construction industry, designers consider buildability important, adequate coordination amongst different design disciplines, adequate channel for co-ordination and communication between designers and constructors at the design stage and adequate support from the government as the top most seven factors supporting buildability assessment implementation in construction sector of Nigeria. Secondly, the results from the research revealed that there is no statistically significant difference in factors supporting buildability assessment implementation in construction between clients and consulting and contracting construction organisations in Nigeria.

The findings provide in-depth insight of the factors supporting the implementation of buildability assessment in construction that can help principal stakeholders in construction to facilitate development of strategies required in supporting the adoption and implementation of buildability assessment tool for buildability improvement.