Search results

This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education.

The application was developed using a design-based research (DBR) methodology. The application’s design was informed by a literature search and needs assessment of quality assurance stakeholders to ensure compliance with daily practices and accreditation requirements. Stakeholders from three study programmes evaluated the application.

As part of the development of the application, module- and programme-level dashboards were created to provide an overview of the programme’s outcomes, assessment methods, assessment metrics, self-evaluated quality indicators and assessment documents. The application was evaluated by stakeholders at the module and programme levels. Overall, the results indicated that the dashboards aided them in gaining insight into the assessment programme and its alignment with underlying assessments.

Visualisation of the assessment programme’s structure and content identifies gaps and opportunities for improvement, which can be used to initiate a dialogue and further actions to improve assessment quality.

The application developed facilitates a cyclical and transparent assessment quality assurance procedure that is continuously available to various stakeholders in quality assurance.

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best-practices in higher education. The paper aims to discuss this issue.

This is Part 2 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs, and the experiences of the two programs during implementation.

The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of a closed-loop assessment of learning outcomes process will take several years to complete.

This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.

In the Netherlands, thesis assessment quality is a growing concern for the national accreditation organization due to increasing student numbers and supervisor workload. However, the accreditation framework lacks guidance on how to meet quality standards. This study aims to address these issues by sharing our experience, identifying problems and proposing guidelines for quality assurance for a thesis assessment system.

This study has two parts. The first part is a narrative literature review conducted to derive guidelines for thesis assessment based on observations made at four Dutch universities. The second part is a case study conducted in one bachelor’s psychology-related program, where the assessment practitioners and the vice program director analyzed the assessment documents based on the guidelines developed from the literature review.

The findings of this study include a list of guidelines based on the four standards. The case study results showed that the program meets most of the guidelines, as it has a comprehensive set of thesis learning outcomes, peer coaching for novice supervisors, clear and complete assessment information and procedures for both examiners and students, and a concise assessment form.

This study is original in that it demonstrates how to holistically ensure the quality of thesis assessments by considering the context of the program and paying more attention to validity (e.g. program curriculum and assessment design), transparency (e.g. integrating assessment into the supervision process) and the assessment expertise of teaching staff.

This study aims to identify the gap between the requirements of the accreditation bodies and the widely used learning management systems (LMSs) in assessing the intended learning outcomes (ILOs). In addition, this study aims to introduce a framework, along with the evaluation of the functionality of the LMS, for measuring the ILO.

A qualitative method was deployed to examine the gap between the requirements of the accreditation standards and the LMS functionalities. The researchers collaborated to design a mechanism, develop a system architecture to measure the ILO in alignment with the accreditation standards and guide the development of the Moodle plugin. The appropriateness and effectiveness of the plugin were evaluated within the scope of assessment mapping and design. Focus group interviews were conducted to collect feedback from the instructors and program leaders regarding its implementation.

The results of this study indicate that there is no standardized mechanism to measure course and program ILO objectively, using the existing LMS. The implementation of the plugin shows the appropriateness and effectiveness of the system in generating ILO achievement reports, which was confirmed by the users.

This study proposed a framework and developed a system architecture for the objective measurement of the ILO through direct assessment. The plugin was tested to generate consistent reports during the measurement of course and program ILO. The plugin has been implemented across Gulf University’s program courses, ensuring appropriate reporting and continuous improvement.

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.

This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.

Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.

One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.

At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.

So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.

The purpose of this research is two-fold: first, the researchers will create a reliable and valid hospitality senior exit survey by conducting a Delphi panel of experts and second, the researchers will pilot-test the instrument with students from a four-year university. The data will be (a) assessed to determine the retention of knowledge by four-year students, (b) used by academicians to make changes to course material and (c) used to help with the accreditation assessment process.

A Delphi panel of hospitality educators was used to validate the items, and graduating hospitality students were used to calculate reliability.

By embracing the hospitality exit survey (HES), institutions can effectively evaluate and enhance their programs. With its ability to gauge students' knowledge retention, the study findings serve as a powerful tool for shaping the future of hospitality education.

The study's findings might be somewhat limited in representing a broader range of perspectives within hospitality programs. Another limitation stems from the structure of the survey itself. The survey included numerous items requiring two inputs for each item. This format has the potential to introduce certain biases among participants.

In a positive statement, organizations can use this information to discover why employees stay and then continue to develop goals/strategies to ensure this process stays up to date. Academia is no different. Academia also wants to produce the best product, and since the students are to become the next set of leaders, these programs need to know what is successful and what needs to be adjusted.

A strategic exit interview program should 1)Uncover issues relating to human resources/students; 2) understand employees'/students' perception of the work; 3) managers'/directors' leadership style and effectiveness; 4) human resource/college/departments benchmarks and 5) improve the organization.

This research holds significant importance as it focuses on developing the senior HES and its potential utilization within hospitality programs. The HES serves as a valuable tool for these programs to evaluate the knowledge levels of their graduating students and collect data necessary for assessment and accreditation purposes.

The purpose of this study is to identify signs of unnecessary assurance of learning (AoL) complexity and to provide suggestions for simplifying the AoL processes.

While this paper is grounded in the existent AoL literature, the paper also presents several anecdotal observations from the authors’ practical knowledge in designing, leading, maintaining and consulting on AoL systems and processes.

Based on both a conceptual review of AoL literature and the authors’ own experiences, the authors outline 13 specific symptoms of unnecessary AoL complexity, identify potential underlying causes for each symptom and propose practical solutions that can increase the efficiency and effectiveness of dysfunctional AoL systems and processes.

Although this work is grounded in the existent AoL literature, the present paper presents several anecdotal observations from the authors’ experiences. While the intent is to provide guidance that is actionable, it is understood that variability exists within and across schools and programs. Future research is needed to provide a more formal structure for reviewing AoL complexity, efficiency and effectiveness.

While future research is needed to provide a more formal structure for reviewing AoL complexity, efficiency and effectiveness, the intent of this paper is to provide guidance that is actionable with the understanding that variability exists within and across schools and programs.

Society increasingly is demanding accountability from institutions of higher learning, and properly structured AoL programs can provide evidence of institutional effectiveness in preparing students to be productive members of society in their chosen fields of study. Stated succinctly, “although accountability matters, learning still matters most” (Angelo, 1999, n.p.).

Consideration of the 13 symptoms presented here along with other drivers that are unique to each school and program should result in the identification and development of practicable remedies to simplify AoL processes and systems, increase efficiency and effectiveness and improve the documentation of improvements to student learning.

Industry and academia around the world stress the importance of professional skills (also known as soft skills, generic skills, or transferable skills) so it is necessary to be able to assess students’ attainment of these skills. An innovative method was developed in the USA for assessment of these skills in an engineering program (Ater Kranov, Hauser, Olsen, & Girardeau, 2008); this method was based around student discussion of an open-ended, unresolved, discipline-related problem, held face-to-face and subsequently analyzed using a rubric. In the research project described here, the method was adapted for the United Arab Emirates by writing appropriate scenarios for computing students, by modifying the rubric and by running the discussion on an online discussion board. The primary aims were to determine the feasibility of adapting the method and to examine its suitability. The results of the study showed that the method can be adapted and employed very successfully with UAE students. This paper presents the method, its adaptation and implementation, and the results obtained.

Clinical practice provides teacher candidates with opportunities to link teaching and learning theory to practice in a supported environment with strong mentorship through their initial phases of teaching. Teacher candidates wait in anticipation for the opportunity to get into classrooms to work alongside veteran teachers to promote student learning and achievement. This article presents one educator preparation program’s (EPP’s) innovative program that spans the boundaries of the USA to provide teacher candidates with a two-week intensive full-time clinical placement in schools located in the Cotswold Region of England.

Highlighted in this piece is the program’s partnership history, design, structure, connection to the nine essentials, assessment of program goals, and a synthesis of the literature on global education and its value in educator preparation.

Highlighted in this piece is the program’s partnership history, design, structure, connection to the nine essentials, assessment of program goals and a synthesis of the literature on global education and its value in educator preparation.

This article highlights one university’s innovation that places teacher candidates in the classroom for a two-week full-time immersive clinical experience in various schools in England. As early as their sophomore year, teacher candidates can participate in this study abroad program and do so while developing their own cultural competence and global citizenship.