Search results

Over the past decade, a growing number of institutions of higher education have added leadership studies as a formal academic program of study. In many instances, however, students have not been included as partners or stakeholders in the design and delivery of leadership education, and student motivation and retention have subsequently suffered (O’Donovan, Rust, & Price, 2016). This application brief describes a new program, Student Assessment Fellows, which aimed to address these concerns by involving a small group of students in several capacities during the reshaping of a university’s leadership program. Through this program, students learned basic tenets of leadership pedagogy and educational program assessment and used both skill sets to author a proposal to restructure the existing academic program. This article reviews the development and design of the program, recommendations from the first cohort, and recommendations for other colleges and universities looking to increase student involvement in educational assessment processes.

This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education.

The application was developed using a design-based research (DBR) methodology. The application’s design was informed by a literature search and needs assessment of quality assurance stakeholders to ensure compliance with daily practices and accreditation requirements. Stakeholders from three study programmes evaluated the application.

As part of the development of the application, module- and programme-level dashboards were created to provide an overview of the programme’s outcomes, assessment methods, assessment metrics, self-evaluated quality indicators and assessment documents. The application was evaluated by stakeholders at the module and programme levels. Overall, the results indicated that the dashboards aided them in gaining insight into the assessment programme and its alignment with underlying assessments.

Visualisation of the assessment programme’s structure and content identifies gaps and opportunities for improvement, which can be used to initiate a dialogue and further actions to improve assessment quality.

The application developed facilitates a cyclical and transparent assessment quality assurance procedure that is continuously available to various stakeholders in quality assurance.

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best-practices in higher education. The paper aims to discuss this issue.

This is Part 2 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs, and the experiences of the two programs during implementation.

The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of a closed-loop assessment of learning outcomes process will take several years to complete.

This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.

As more institutions of higher education engage in the practice of leadership education, the effective assessment of these efforts lags behind due to a variety of factors. Without an intentional assessment plan, leadership educators are liable to make one or more of several common errors in assessing their programs and activities. This article reviews some of the most common errors in assessing leadership programs, including failing to consider what the authors describe as the Honeymoon, Horizon, Hollywood, Halo, and Hallmark effects (otherwise known as recency, response-shift, socially desirable, and respondent biases). Suggestions for minimizing these potential issues in assessment are also included along with suggestions for practitioners and areas for future related research.

Student learning outcomes assessment, when done right, is an ongoing and systematic process. Faculty and staff for leadership education programs often struggle to develop a comprehensive approach to assess the effectiveness of their programs, especially when those programs are offered through multiple modes of instruction. One department at a Midwestern public university has developed a thorough, five-stage process which any leadership education program can follow, regardless of size or method of delivery. This department considers three modes of instruction, including face-to-face on a traditional American campus, asynchronous online, and face-to-face at foreign universities via international partnerships. This manuscript describes the comprehensive process and offers readers considerations for implementation at their own institution.

This study aims to identify the gap between the requirements of the accreditation bodies and the widely used learning management systems (LMSs) in assessing the intended learning outcomes (ILOs). In addition, this study aims to introduce a framework, along with the evaluation of the functionality of the LMS, for measuring the ILO.

A qualitative method was deployed to examine the gap between the requirements of the accreditation standards and the LMS functionalities. The researchers collaborated to design a mechanism, develop a system architecture to measure the ILO in alignment with the accreditation standards and guide the development of the Moodle plugin. The appropriateness and effectiveness of the plugin were evaluated within the scope of assessment mapping and design. Focus group interviews were conducted to collect feedback from the instructors and program leaders regarding its implementation.

The results of this study indicate that there is no standardized mechanism to measure course and program ILO objectively, using the existing LMS. The implementation of the plugin shows the appropriateness and effectiveness of the system in generating ILO achievement reports, which was confirmed by the users.

This study proposed a framework and developed a system architecture for the objective measurement of the ILO through direct assessment. The plugin was tested to generate consistent reports during the measurement of course and program ILO. The plugin has been implemented across Gulf University’s program courses, ensuring appropriate reporting and continuous improvement.

This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.

This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.

Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.

One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.

At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.

So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.

The purpose of this application manuscript is to address assessing and evaluating the impact of leadership mentoring programs on collegiate mentors. Specifically, this paper addresses the nuanced considerations of creating appropriate program outcomes and associated objectives given the individualized nature of mentoring relationships. Additionally, the current paper discusses assessment and evaluation strategies to demonstrate impact of leadership mentoring on the collegiate mentor via a three-year program evaluation effort. By innovating leadership mentoring program practice, leadership educators can more soundly design and deliver leadership mentoring programs and more precisely measure and demonstrate impact.

It is widely understood that distinctive leadership programs must engage in assessment, and intentional program improvement practices. Design thinking can serve as one student-centered tool that engages students in the assessment process, while looping feedback into substantive programmatic changes. This paper explores the use of this innovative practice to enhance a co-curricular leadership program at a large university in the Southeastern United States. Practitioners found that design thinking was a useful supplemental assessment tool that led to positive programmatic changes that were focused on students’ needs.

The International Leadership Association’s Guiding Questions: Guidelines for Leadership Education Programs (Ritch & Mengel, 2009) provides a framework to attend to leadership program development, redesign, evaluation, organized program review, questions concerning academic legitimacy and developing common program benchmarks. This article provides a critique of the Guiding Questions: Guidelines for Leadership Education Programs and, in particular, the five major categories: Conceptual Framework, Context, Content, Teaching and Learning, and Outcomes/Assessment. The article also draws upon scholarly research within the field to provide both breadth and depth to the different Guiding Questions categories. Finally, the goal of this article is to encourage a collaborative dialogue which will ultimately increase the effectiveness of the Guiding Questions.