Search results

1 – 10 of over 85000
Open Access
Article
Publication date: 12 August 2022

Hesham El Marsafawy, Rumpa Roy and Fahema Ali

This study aims to identify the gap between the requirements of the accreditation bodies and the widely used learning management systems (LMSs) in assessing the intended learning

1450

Abstract

Purpose

This study aims to identify the gap between the requirements of the accreditation bodies and the widely used learning management systems (LMSs) in assessing the intended learning outcomes (ILOs). In addition, this study aims to introduce a framework, along with the evaluation of the functionality of the LMS, for measuring the ILO.

Design/methodology/approach

A qualitative method was deployed to examine the gap between the requirements of the accreditation standards and the LMS functionalities. The researchers collaborated to design a mechanism, develop a system architecture to measure the ILO in alignment with the accreditation standards and guide the development of the Moodle plugin. The appropriateness and effectiveness of the plugin were evaluated within the scope of assessment mapping and design. Focus group interviews were conducted to collect feedback from the instructors and program leaders regarding its implementation.

Findings

The results of this study indicate that there is no standardized mechanism to measure course and program ILO objectively, using the existing LMS. The implementation of the plugin shows the appropriateness and effectiveness of the system in generating ILO achievement reports, which was confirmed by the users.

Originality/value

This study proposed a framework and developed a system architecture for the objective measurement of the ILO through direct assessment. The plugin was tested to generate consistent reports during the measurement of course and program ILO. The plugin has been implemented across Gulf University’s program courses, ensuring appropriate reporting and continuous improvement.

Details

Quality Assurance in Education, vol. 30 no. 4
Type: Research Article
ISSN: 0968-4883

Keywords

Article
Publication date: 9 October 2017

William F. Heinrich

The purpose of this paper is to explore the enacted mental models, the types of thinking and action, of assessment held by faculty and staff in higher education.

Abstract

Purpose

The purpose of this paper is to explore the enacted mental models, the types of thinking and action, of assessment held by faculty and staff in higher education.

Design/methodology/approach

This research approaches the question: in what ways are “learning outcomes assessment” understood (thinking) as part of a system and assessed in the individual’s work (practice)?” Interviews and concept maps were used to identify influences, descriptions of actions, and connections to environments for 12 participants, known to have engaged in learning outcomes assessment.

Findings

By connecting individual perspectives to broader organizational understanding, a goal of this research was to identify and analyze how educators understand and practice learning outcomes assessment in higher education. Influences on assessment presented in the literature are confirmed and several behavioral types are defined and categorized.

Research limitations/implications

The findings focus attention on the ways individuals act on influences in systems of higher education. The findings yield opportunities for new ways to utilize assessment knowledge. The study is small and has implications for similar type institutions.

Practical implications

Faculty and staff can use these findings to create training and development protocols and/or adjust their own practices of assessment. Assessment professionals can apply findings to consulting on an array of assessment projects and with staff who have varying skill levels.

Social implications

The ways in which assessment is practiced is deeply influenced by training but is also shaped heavily by current environments and accountability structures. Policies and practices related to such environments can make a difference in preparing for scaled-up assessment practices and projects.

Originality/value

This research offers insight into possible archetypes of assessment behaviors and presents applied influences on assessment.

Details

Journal of Applied Research in Higher Education, vol. 9 no. 4
Type: Research Article
ISSN: 2050-7003

Keywords

Article
Publication date: 19 February 2020

Alrence Santiago Halibas, Shameena Mehtab, Alaa Al-Attili, Benjamin Alo, Ronald Cordova and Maria Elisa Linda Taeza Cruz

Graduates are expected to possess the knowledge and right skillset, commonly known as graduate attributes, which they need to become employable and work-ready. This study…

Abstract

Purpose

Graduates are expected to possess the knowledge and right skillset, commonly known as graduate attributes, which they need to become employable and work-ready. This study describes the approaches that were employed by an academic institution in developing an assessment framework for measuring the student achievement of the graduate attributes and learning outcomes.

Design/methodology/approach

It used thematic analysis in analyzing the 43 audit reports of higher educational institutions (HEIs) in Oman which have undergone the regional quality audit as well as the outcomes of the institutional standards assessment.

Findings

The analysis exposed the critical issues necessary for embedding graduate attributes and learning outcomes in higher education. Likewise, the study revealed that the assessment of the graduate attributes (GAs) and learning outcomes (LOs) is the area that garnered the most number of comments from the audit panel, and 69 per cent of the HEIs are still problematic in this area. Moreover, most of the HEIs in Oman lack the mechanisms to assess student learning as evidenced in the regional accreditation outcomes. Only 43.8 per cent of the HEIs, which have undergone the institutional accreditation process, have garnered a Met Rating in the Graduate Attributes and Student Learning Outcome criterion. Hence, this study presupposes its high relevance and usefulness to the work in this area, drawing from the experience of an HEI in Oman.

Practical implications

This study will present the relevant and meaningful content, especially good practices and potential gaps that inform HEIs regarding the current trends, policies, and practices relevant to the assessment of graduate attributes and learning outcomes in higher education.

Originality/value

This study extends the limited literature on the assessment of graduate attributes and learning outcomes, especially among the HEIs in Oman.

Details

International Journal of Educational Management, vol. 34 no. 5
Type: Research Article
ISSN: 0951-354X

Keywords

Open Access
Article
Publication date: 31 May 2019

Allen Z. Reich, Galen R. Collins, Agnes L. DeFranco and Suzanne L. Pieper

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that…

1191

Abstract

Purpose

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best-practices in higher education. The paper aims to discuss this issue.

Design/methodology/approach

This is Part 2 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs, and the experiences of the two programs during implementation.

Findings

The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of a closed-loop assessment of learning outcomes process will take several years to complete.

Originality/value

This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.

Details

International Hospitality Review, vol. 33 no. 1
Type: Research Article
ISSN: 2516-8142

Keywords

Article
Publication date: 5 February 2018

Barbara Blummer and Jeffrey M. Kenton

The purpose of this paper is to examine the literature on student learning outcomes and academic libraries. An analysis of 81 papers revealed the following themes: outcomes

1755

Abstract

Purpose

The purpose of this paper is to examine the literature on student learning outcomes and academic libraries. An analysis of 81 papers revealed the following themes: outcomes assessment of library skills instruction, tools for assessing students’ achievement of learning outcomes, institutional accreditation and student learning outcomes, academic libraries’ impact on student learning outcomes, and the creation of learning outcomes. An understanding of these themes highlights how student learning outcomes are created, assessed, and valued in the academy.

Design/methodology/approach

The methodology centered on a literature review of student learning outcomes and academic libraries from 2001 to the present. To identify relevant articles on this topic, the authors searched the library literature with various combinations of the following keywords: learning outcomes, library, academic, university, college, and higher education.

Findings

An analysis of 81 papers on student learning outcomes and academic libraries revealed the following five themes: outcomes assessment of library skills instruction, assessment tools for student learning outcomes, institutional accreditation and student learning outcomes, academic libraries’ impact on student learning outcomes, and the creation of learning outcomes.

Research limitations/implications

The research was limited to articles published in English and after 2000.

Practical implications

The findings can be utilized to inform instructional librarians about creating and assessing student learning outcomes. In addition, the paper can assist librarians in forging partnerships with academic departments and faculty in creating student learning outcomes to support course and departmental outcomes and accreditation efforts.

Originality/value

The research offers librarians opportunities to incorporate student learning outcomes in library instruction as well as collaborate with faculty in creating student learning outcomes.

Details

Performance Measurement and Metrics, vol. 19 no. 1
Type: Research Article
ISSN: 1467-8047

Keywords

Open Access
Article
Publication date: 3 May 2019

Allen Z. Reich, Galen R. Collins, Agnes L. DeFranco and Suzanne L. Pieper

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments, and students’ demand for an education that…

1537

Abstract

Purpose

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments, and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best practices in higher education. The paper aims to discuss this issue.

Design/methodology/approach

This is Part 1 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs and the experiences of the two programs during implementation of the seven steps. Part 1 includes foundational principles of the process and the first three of the seven steps.

Findings

The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when to implement them. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of an effective closed-loop assessment of learning outcomes process will take several years to complete.

Originality/value

This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.

Details

International Hospitality Review, vol. 33 no. 1
Type: Research Article
ISSN: 2516-8142

Keywords

Article
Publication date: 15 April 2022

Jeff Bourgeois, Kaley Klaus and Jeni McRay

Student learning outcomes assessment, when done right, is an ongoing and systematic process. Faculty and staff for leadership education programs often struggle to develop a…

Abstract

Student learning outcomes assessment, when done right, is an ongoing and systematic process. Faculty and staff for leadership education programs often struggle to develop a comprehensive approach to assess the effectiveness of their programs, especially when those programs are offered through multiple modes of instruction. One department at a Midwestern public university has developed a thorough, five-stage process which any leadership education program can follow, regardless of size or method of delivery. This department considers three modes of instruction, including face-to-face on a traditional American campus, asynchronous online, and face-to-face at foreign universities via international partnerships. This manuscript describes the comprehensive process and offers readers considerations for implementation at their own institution.

Details

Journal of Leadership Education, vol. 21 no. 2
Type: Research Article
ISSN: 1552-9045

Article
Publication date: 7 September 2015

Marina Brinkman-Staneva

The purpose of this paper is to highlight some inadequacies of the position of lecturers’ qualifications to design assessments within hospitality curricula while meeting the…

Abstract

Purpose

The purpose of this paper is to highlight some inadequacies of the position of lecturers’ qualifications to design assessments within hospitality curricula while meeting the requirements of international and national quality frameworks.The Framework for Qualifications of the European Higher Education Area leaves the responsibility for designing appropriate teaching and assessment strategies in the hands of educators without fully recognizing the complexity of formulating the desired learning outcomes. Additionally, the subject-oriented background of the majority of educators within universities of applied sciences seems to be ignored in respect of its influence on assessment design.

Design/methodology/approach

This paper reflects on the author’s experience in designing courses, teaching and assessment strategies at the NHTV University of Applied Sciences in The Netherlands, as well as observations of processes at other universities of applied sciences.

Findings

The author argues for a uniform delineation of hospitality professional qualifications which integrates learning outcomes from international, national and industry profiles. It is proposed that course design should start with assessment design to achieve alignment with learning outcomes and instructional strategies. Universities of applied sciences will have to train course designers in advanced assessment methods and encourage all faculty to acquire appropriate didactical training in assessing students.

Practical implications

This paper offers a view on the strategy necessary to ensuring adequate preparation of lecturers in the areas of writing–learning outcomes and preparing assessment.

Originality/value

The value of the paper lies in the fact that it is a unique critique of pedagogy in Dutch universities of applied sciences.

Details

Quality Assurance in Education, vol. 23 no. 4
Type: Research Article
ISSN: 0968-4883

Keywords

Article
Publication date: 29 November 2018

Kwok Hung Lau, Tri Khai Lam, Booi Hon Kam, Mathews Nkhoma and Joan Richardson

The purpose of this paper is to propose a scalable quantitative approach to evaluate alignment within and between courses and programs in higher education for benchmarking purpose.

2655

Abstract

Purpose

The purpose of this paper is to propose a scalable quantitative approach to evaluate alignment within and between courses and programs in higher education for benchmarking purpose.

Design/methodology/approach

The revised Bloom’s taxonomy, which combines a cognitive process dimension and a knowledge dimension, is used as a basis for categorizing national standards, program and course learning outcomes (CLOs) and assessment methods. Alignments between programs and national standards, programs and courses and assessment tasks and courses are then measured using a series of Cohen’s κ statistics. Two undergraduate business programs offered at an Australian university were used as examples to demonstrate the proposed method as an alignment evaluation tool.

Findings

The findings reveal that the two sample programs are better aligned with national standards than with their respective constituent courses. The degree of alignment between CLOs and assessment methods varies from course to course within the programs. This might be related to the lack of clarity of some learning outcome statements and the complexity of certain assessment methods.

Research limitations/implications

This study lends insight into the use of an alignment mapping for benchmarking academic programs in higher education. To serve mainly as an illustration of the proposed approach, the case study is limited to two undergraduate business programs offered at the same university.

Practical implications

Universities can use the proposed approach to benchmark their academic programs against the national standards and similar programs offered by other competing educational institutions. The alignment indices can also serve as yardsticks to continuously improve the consistencies within and among academic programs to ensure quality.

Originality/value

The proposed method offers a consistent basis to compare the degrees of alignment of different higher education programs with national standards and their respective constituent courses, hence enabling benchmarking for continuous improvement. It also reveals how the alignment between different parameters in teaching and learning can be improved, thereby facilitating incremental learning and enhancing student performance.

Details

Benchmarking: An International Journal, vol. 25 no. 8
Type: Research Article
ISSN: 1463-5771

Keywords

Book part
Publication date: 29 January 2021

Olga Zlatkin-Troitschanskaia and Miriam Toepper

This chapter outlines the challenges that research and practice in higher education have faced in measuring students' competences and learning outcomes. Particular attention is…

Abstract

This chapter outlines the challenges that research and practice in higher education have faced in measuring students' competences and learning outcomes. Particular attention is given to the systematic and institutional contexts in Germany. Based on the outlined national and international contextual framework, the Germany-wide program “Modeling and Measuring Competences in Higher Education (KoKoHs)” is discussed in terms of its two central working stages, key outcomes and lessons learned. In particular, the central results of the second phase are presented for the first time and integrated into the current state of international research. Based on this analysis, perspectives for further research on student learning in higher education and implications for practice and policy are derived.

1 – 10 of over 85000