Search results

1 – 10 of over 116000
Article
Publication date: 9 October 2017

William F. Heinrich

The purpose of this paper is to explore the enacted mental models, the types of thinking and action, of assessment held by faculty and staff in higher education.

Abstract

Purpose

The purpose of this paper is to explore the enacted mental models, the types of thinking and action, of assessment held by faculty and staff in higher education.

Design/methodology/approach

This research approaches the question: in what ways are “learning outcomes assessment” understood (thinking) as part of a system and assessed in the individual’s work (practice)?” Interviews and concept maps were used to identify influences, descriptions of actions, and connections to environments for 12 participants, known to have engaged in learning outcomes assessment.

Findings

By connecting individual perspectives to broader organizational understanding, a goal of this research was to identify and analyze how educators understand and practice learning outcomes assessment in higher education. Influences on assessment presented in the literature are confirmed and several behavioral types are defined and categorized.

Research limitations/implications

The findings focus attention on the ways individuals act on influences in systems of higher education. The findings yield opportunities for new ways to utilize assessment knowledge. The study is small and has implications for similar type institutions.

Practical implications

Faculty and staff can use these findings to create training and development protocols and/or adjust their own practices of assessment. Assessment professionals can apply findings to consulting on an array of assessment projects and with staff who have varying skill levels.

Social implications

The ways in which assessment is practiced is deeply influenced by training but is also shaped heavily by current environments and accountability structures. Policies and practices related to such environments can make a difference in preparing for scaled-up assessment practices and projects.

Originality/value

This research offers insight into possible archetypes of assessment behaviors and presents applied influences on assessment.

Details

Journal of Applied Research in Higher Education, vol. 9 no. 4
Type: Research Article
ISSN: 2050-7003

Keywords

Article
Publication date: 19 February 2020

Alrence Santiago Halibas, Shameena Mehtab, Alaa Al-Attili, Benjamin Alo, Ronald Cordova and Maria Elisa Linda Taeza Cruz

Graduates are expected to possess the knowledge and right skillset, commonly known as graduate attributes, which they need to become employable and work-ready. This study…

Abstract

Purpose

Graduates are expected to possess the knowledge and right skillset, commonly known as graduate attributes, which they need to become employable and work-ready. This study describes the approaches that were employed by an academic institution in developing an assessment framework for measuring the student achievement of the graduate attributes and learning outcomes.

Design/methodology/approach

It used thematic analysis in analyzing the 43 audit reports of higher educational institutions (HEIs) in Oman which have undergone the regional quality audit as well as the outcomes of the institutional standards assessment.

Findings

The analysis exposed the critical issues necessary for embedding graduate attributes and learning outcomes in higher education. Likewise, the study revealed that the assessment of the graduate attributes (GAs) and learning outcomes (LOs) is the area that garnered the most number of comments from the audit panel, and 69 per cent of the HEIs are still problematic in this area. Moreover, most of the HEIs in Oman lack the mechanisms to assess student learning as evidenced in the regional accreditation outcomes. Only 43.8 per cent of the HEIs, which have undergone the institutional accreditation process, have garnered a Met Rating in the Graduate Attributes and Student Learning Outcome criterion. Hence, this study presupposes its high relevance and usefulness to the work in this area, drawing from the experience of an HEI in Oman.

Practical implications

This study will present the relevant and meaningful content, especially good practices and potential gaps that inform HEIs regarding the current trends, policies, and practices relevant to the assessment of graduate attributes and learning outcomes in higher education.

Originality/value

This study extends the limited literature on the assessment of graduate attributes and learning outcomes, especially among the HEIs in Oman.

Details

International Journal of Educational Management, vol. 34 no. 5
Type: Research Article
ISSN: 0951-354X

Keywords

Open Access
Article
Publication date: 31 May 2019

Allen Z. Reich, Galen R. Collins, Agnes L. DeFranco and Suzanne L. Pieper

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that…

1191

Abstract

Purpose

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best-practices in higher education. The paper aims to discuss this issue.

Design/methodology/approach

This is Part 2 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs, and the experiences of the two programs during implementation.

Findings

The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of a closed-loop assessment of learning outcomes process will take several years to complete.

Originality/value

This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.

Details

International Hospitality Review, vol. 33 no. 1
Type: Research Article
ISSN: 2516-8142

Keywords

Open Access
Article
Publication date: 12 August 2022

Hesham El Marsafawy, Rumpa Roy and Fahema Ali

This study aims to identify the gap between the requirements of the accreditation bodies and the widely used learning management systems (LMSs) in assessing the intended learning…

1445

Abstract

Purpose

This study aims to identify the gap between the requirements of the accreditation bodies and the widely used learning management systems (LMSs) in assessing the intended learning outcomes (ILOs). In addition, this study aims to introduce a framework, along with the evaluation of the functionality of the LMS, for measuring the ILO.

Design/methodology/approach

A qualitative method was deployed to examine the gap between the requirements of the accreditation standards and the LMS functionalities. The researchers collaborated to design a mechanism, develop a system architecture to measure the ILO in alignment with the accreditation standards and guide the development of the Moodle plugin. The appropriateness and effectiveness of the plugin were evaluated within the scope of assessment mapping and design. Focus group interviews were conducted to collect feedback from the instructors and program leaders regarding its implementation.

Findings

The results of this study indicate that there is no standardized mechanism to measure course and program ILO objectively, using the existing LMS. The implementation of the plugin shows the appropriateness and effectiveness of the system in generating ILO achievement reports, which was confirmed by the users.

Originality/value

This study proposed a framework and developed a system architecture for the objective measurement of the ILO through direct assessment. The plugin was tested to generate consistent reports during the measurement of course and program ILO. The plugin has been implemented across Gulf University’s program courses, ensuring appropriate reporting and continuous improvement.

Details

Quality Assurance in Education, vol. 30 no. 4
Type: Research Article
ISSN: 0968-4883

Keywords

Article
Publication date: 5 February 2018

Barbara Blummer and Jeffrey M. Kenton

The purpose of this paper is to examine the literature on student learning outcomes and academic libraries. An analysis of 81 papers revealed the following themes: outcomes

1755

Abstract

Purpose

The purpose of this paper is to examine the literature on student learning outcomes and academic libraries. An analysis of 81 papers revealed the following themes: outcomes assessment of library skills instruction, tools for assessing students’ achievement of learning outcomes, institutional accreditation and student learning outcomes, academic libraries’ impact on student learning outcomes, and the creation of learning outcomes. An understanding of these themes highlights how student learning outcomes are created, assessed, and valued in the academy.

Design/methodology/approach

The methodology centered on a literature review of student learning outcomes and academic libraries from 2001 to the present. To identify relevant articles on this topic, the authors searched the library literature with various combinations of the following keywords: learning outcomes, library, academic, university, college, and higher education.

Findings

An analysis of 81 papers on student learning outcomes and academic libraries revealed the following five themes: outcomes assessment of library skills instruction, assessment tools for student learning outcomes, institutional accreditation and student learning outcomes, academic libraries’ impact on student learning outcomes, and the creation of learning outcomes.

Research limitations/implications

The research was limited to articles published in English and after 2000.

Practical implications

The findings can be utilized to inform instructional librarians about creating and assessing student learning outcomes. In addition, the paper can assist librarians in forging partnerships with academic departments and faculty in creating student learning outcomes to support course and departmental outcomes and accreditation efforts.

Originality/value

The research offers librarians opportunities to incorporate student learning outcomes in library instruction as well as collaborate with faculty in creating student learning outcomes.

Details

Performance Measurement and Metrics, vol. 19 no. 1
Type: Research Article
ISSN: 1467-8047

Keywords

Article
Publication date: 15 May 2007

Ada Emmett and Judith Emde

The purpose of this study is to obtain preliminary evidence over a three‐year period on the efficacy of a curriculum designed to foster information literacy skills in graduate…

5773

Abstract

Purpose

The purpose of this study is to obtain preliminary evidence over a three‐year period on the efficacy of a curriculum designed to foster information literacy skills in graduate students in a chemistry bibliography course.

Design/methodology/approach

Specifically, the researchers examined the application and results of an assessment tool and its connectivity to instructional strategies for improving literacy outcomes. ACRL's “Information literacy competency standards for higher education” provided the basis for the construction of the assessment tool. The instrument was given to chemistry graduate students enrolled in the course at the beginning and at the end of the semester.

Findings

The assessment results from all three years indicated marked improvements in the average student score from the pre‐ to the post‐test. The assessment provided evidence of skill development over the course of the semester for specified outcomes.

Research limitations/implications

The research would have been strengthened by the use of a valid control group of graduate students in related chemistry majors who were not enrolled in the class. The extended study would have supplied rates of improvement in the control group over a given period of time compared with rates of improvement of students enrolled in the class.

Practical implications

The paper provides methods for approaching the assessment of information literacy skills by focusing on tool development based on desired learning outcomes.

Originality/value

The study developed, refined and applied a methodology to assess student information literacy skills based on learning outcomes over a three‐year period. The literature lacks reports of studies looking at the assessment of information literacy development of graduate students in the sciences as well as the use of “backward design” in creating evaluative tools.

Details

Reference Services Review, vol. 35 no. 2
Type: Research Article
ISSN: 0090-7324

Keywords

Article
Publication date: 15 April 2022

Jeff Bourgeois, Kaley Klaus and Jeni McRay

Student learning outcomes assessment, when done right, is an ongoing and systematic process. Faculty and staff for leadership education programs often struggle to develop a…

Abstract

Student learning outcomes assessment, when done right, is an ongoing and systematic process. Faculty and staff for leadership education programs often struggle to develop a comprehensive approach to assess the effectiveness of their programs, especially when those programs are offered through multiple modes of instruction. One department at a Midwestern public university has developed a thorough, five-stage process which any leadership education program can follow, regardless of size or method of delivery. This department considers three modes of instruction, including face-to-face on a traditional American campus, asynchronous online, and face-to-face at foreign universities via international partnerships. This manuscript describes the comprehensive process and offers readers considerations for implementation at their own institution.

Details

Journal of Leadership Education, vol. 21 no. 2
Type: Research Article
ISSN: 1552-9045

Abstract

Details

A Machine Learning, Artificial Intelligence Approach to Institutional Effectiveness in Higher Education
Type: Book
ISBN: 978-1-78973-900-8

Article
Publication date: 1 January 2006

Elizabeth Choinski and Michelle Emanuel

To describe the design and use of an outcomes assessment tool for one‐shot library instruction classes that is objective, quantitative, easy to use, and flexible.

3931

Abstract

Purpose

To describe the design and use of an outcomes assessment tool for one‐shot library instruction classes that is objective, quantitative, easy to use, and flexible.

Design/methodology/approach

An “outcomesassessment tool was created based on the ideas of the one‐minute paper and student reflection papers. The tool was administered to classes in Spanish and Biology that had one shot library sessions.

Findings

The assessment tool was helpful in pointing out areas where librarians need to improve instruction in their one shot classes. The tool was useful, easy to use, and fulfilled our objectives.

Research limitations/implications

The tool's use may be limited to institutions where there is excellent rapport between librarians and course instructors or to libraries with a staff large enough to find volunteers to grade the papers outside of the course librarian.

Practical implications

The tool developed provides one more weapon for the outcomes assessment arsenal.

Originality/value

This contribution is unique; there is no other outcomes assessment tool for one‐shot classes in the library literature. Because one‐shot sessions are the majority of library instruction appearances and because outcomes assessment is very important, this tool should be of great practical help to instruction librarians.

Details

Reference Services Review, vol. 34 no. 1
Type: Research Article
ISSN: 0090-7324

Keywords

Open Access
Article
Publication date: 3 May 2019

Allen Z. Reich, Galen R. Collins, Agnes L. DeFranco and Suzanne L. Pieper

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments, and students’ demand for an education that…

1537

Abstract

Purpose

Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments, and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best practices in higher education. The paper aims to discuss this issue.

Design/methodology/approach

This is Part 1 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs and the experiences of the two programs during implementation of the seven steps. Part 1 includes foundational principles of the process and the first three of the seven steps.

Findings

The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when to implement them. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of an effective closed-loop assessment of learning outcomes process will take several years to complete.

Originality/value

This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.

Details

International Hospitality Review, vol. 33 no. 1
Type: Research Article
ISSN: 2516-8142

Keywords

1 – 10 of over 116000