Search results
1 – 10 of over 13000Allen Z. Reich, Galen R. Collins, Agnes L. DeFranco and Suzanne L. Pieper
Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that…
Abstract
Purpose
Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best-practices in higher education. The paper aims to discuss this issue.
Design/methodology/approach
This is Part 2 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs, and the experiences of the two programs during implementation.
Findings
The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of a closed-loop assessment of learning outcomes process will take several years to complete.
Originality/value
This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.
Details
Keywords
Allen Z. Reich, Galen R. Collins, Agnes L. DeFranco and Suzanne L. Pieper
Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments, and students’ demand for an education that…
Abstract
Purpose
Because of the increasingly higher expectations of accrediting organizations, calls for greater accountability from state governments, and students’ demand for an education that prepares them for a career, most hospitality programs are now required to have an effective assessment of learning outcomes process. The increasing popularity of the assessment of learning outcomes process is viewed as highly positive because it can be considered as best practices in higher education. The paper aims to discuss this issue.
Design/methodology/approach
This is Part 1 of a two-part article that provides an overview of the justifications for implementing an assessment of learning outcomes process, the steps that were developed by two hospitality programs and the experiences of the two programs during implementation of the seven steps. Part 1 includes foundational principles of the process and the first three of the seven steps.
Findings
The steps in a closed-loop assessment of learning outcomes process are relatively detailed; however, because of changes in expectations of stakeholders and the requirements of accreditors, they are now mandatory for most hospitality programs. Therefore, the choice is not whether to implement them, but when to implement them. From a competitive standpoint, it is to the program’s advantage to begin as soon as possible. Another factor to consider is that the implementation of an effective closed-loop assessment of learning outcomes process will take several years to complete.
Originality/value
This paper is presenting a critical view of one of, if not the most important concepts in higher education, the closed-loop assessment of learning outcomes process. Hopefully, the information on the process that is provided and the experiences of the two programs can shorten the learning curve for other hospitality programs.
Details
Keywords
Kate Murphy and Sarah Governey
The purpose of this paper is to feedback the results of a survey of paediatric occupational therapists completed by the Paediatric Advisory Group (PAG) regarding perceptions and…
Abstract
Purpose
The purpose of this paper is to feedback the results of a survey of paediatric occupational therapists completed by the Paediatric Advisory Group (PAG) regarding perceptions and practices of the assessment of need (AON) process. This survey was completed to gather feedback from occupational therapists about the impact of the AON process on paediatric occupational therapy practice in Ireland.
Design/methodology/approach
A questionnaire was developed by the authors, who were on the PAG committee, to specifically gather quantitative and qualitative information about the AON. A snowball sampling method was utilised. The results were grouped into themes related to the practices and recommendations from occupational therapists nationally.
Findings
Surveys were returned from 98 paediatric occupational therapists with a wide national geographical spread with the majority working in the HSE. The amount of time spent on AON assessments, as well as the length of reports, varied nationally. The process of how assessments were completed (unidisciplinary or multidisciplinary) and whether a diagnosis was provided was inconsistent. Concerns were raised about the negative ethical impact of the AON on service provision and intervention and the need for further training of staff along with more frequent assessment reviews. The respondents also highlighted concerns about the increasing age of the AON criteria, with no increase in resources, and they provided suggestions for improvements for the future.
Research limitations/implications
The survey was sent to all AOTI and PAG members via gatekeepers and then forwarded to others, resulting in a snowball sampling technique; however, this does not represent all paediatric occupational therapists nationally as membership in these groups is voluntary.
Practical implications
The concerns and inequities raised in the survey regarding occupational therapy practices of completing the AON process need to be shared with relevant stakeholders both at the occupational therapy management level and in the HSE and Department of Health/Disability. The PAG will continue to highlight these concerns from their members to relevant parties and by disseminating findings in articles such as this.
Social implications
Ethical concerns were raised by some members about the equity of access to interventions as a result of the AON process. The social implication of this for families and children is pertinent, particularly in the context of the increased age in the AON criteria without any increase in resources.
Originality/value
The PAG aims to support paediatric occupational therapists nationally and the committee often gathers feedback from members regarding concerns which affect day-to-day practice in paediatric OT. Sharing of this information with IJOT readers helps to highlight the challenges faced by paediatric occupational therapists nationally.
Details
Keywords
Karen A. Tarnoff, Kathleen J. Barnes and Eric D. Bostwick
The purpose of this study is to identify signs of unnecessary assurance of learning (AoL) complexity and to provide suggestions for simplifying the AoL processes.
Abstract
Purpose
The purpose of this study is to identify signs of unnecessary assurance of learning (AoL) complexity and to provide suggestions for simplifying the AoL processes.
Design/methodology/approach
While this paper is grounded in the existent AoL literature, the paper also presents several anecdotal observations from the authors’ practical knowledge in designing, leading, maintaining and consulting on AoL systems and processes.
Findings
Based on both a conceptual review of AoL literature and the authors’ own experiences, the authors outline 13 specific symptoms of unnecessary AoL complexity, identify potential underlying causes for each symptom and propose practical solutions that can increase the efficiency and effectiveness of dysfunctional AoL systems and processes.
Research limitations/implications
Although this work is grounded in the existent AoL literature, the present paper presents several anecdotal observations from the authors’ experiences. While the intent is to provide guidance that is actionable, it is understood that variability exists within and across schools and programs. Future research is needed to provide a more formal structure for reviewing AoL complexity, efficiency and effectiveness.
Practical implications
While future research is needed to provide a more formal structure for reviewing AoL complexity, efficiency and effectiveness, the intent of this paper is to provide guidance that is actionable with the understanding that variability exists within and across schools and programs.
Social implications
Society increasingly is demanding accountability from institutions of higher learning, and properly structured AoL programs can provide evidence of institutional effectiveness in preparing students to be productive members of society in their chosen fields of study. Stated succinctly, “although accountability matters, learning still matters most” (Angelo, 1999, n.p.).
Originality/value
Consideration of the 13 symptoms presented here along with other drivers that are unique to each school and program should result in the identification and development of practicable remedies to simplify AoL processes and systems, increase efficiency and effectiveness and improve the documentation of improvements to student learning.
Details
Keywords
Ya-Ping (Amy) Hsiao, Gerard van de Watering, Marthe Heitbrink, Helma Vlas and Mei-Shiu Chiu
In the Netherlands, thesis assessment quality is a growing concern for the national accreditation organization due to increasing student numbers and supervisor workload. However…
Abstract
Purpose
In the Netherlands, thesis assessment quality is a growing concern for the national accreditation organization due to increasing student numbers and supervisor workload. However, the accreditation framework lacks guidance on how to meet quality standards. This study aims to address these issues by sharing our experience, identifying problems and proposing guidelines for quality assurance for a thesis assessment system.
Design/methodology/approach
This study has two parts. The first part is a narrative literature review conducted to derive guidelines for thesis assessment based on observations made at four Dutch universities. The second part is a case study conducted in one bachelor’s psychology-related program, where the assessment practitioners and the vice program director analyzed the assessment documents based on the guidelines developed from the literature review.
Findings
The findings of this study include a list of guidelines based on the four standards. The case study results showed that the program meets most of the guidelines, as it has a comprehensive set of thesis learning outcomes, peer coaching for novice supervisors, clear and complete assessment information and procedures for both examiners and students, and a concise assessment form.
Originality/value
This study is original in that it demonstrates how to holistically ensure the quality of thesis assessments by considering the context of the program and paying more attention to validity (e.g. program curriculum and assessment design), transparency (e.g. integrating assessment into the supervision process) and the assessment expertise of teaching staff.
Details
Keywords
Clemens Harten, Matthias Meyer and Lucia Bellora-Bienengräber
This paper aims to explore drivers of the effectiveness of risk assessments in risk workshops.
Abstract
Purpose
This paper aims to explore drivers of the effectiveness of risk assessments in risk workshops.
Design/methodology/approach
This study uses an agent-based model to simulate risk assessments in risk workshops. Combining the notions of transactive memory and the ideal speech situation, this study establishes a risk assessment benchmark and then investigates real-world deviations from this benchmark. Specifically, this study models limits to information transfer, incomplete discussions and potentially detrimental group characteristics, as well as interaction patterns.
Findings
First, limits to information transfer among workshop participants can prevent a correct consensus. Second, increasing the required number of stable discussion rounds before an assessment improves the correct assessment of high but not low likelihood risks. Third, while theoretically advantageous group characteristics are associated with the highest assessment correctness for all risks, theoretically detrimental group characteristics are associated with the highest assessment correctness for high likelihood risks. Fourth, prioritizing participants who are particularly concerned about the risk leads to the highest level of correctness.
Originality/value
This study shows that by increasing the duration of simulated risk workshops, the assessments change – as a rule – from underestimating to overestimating risks, unraveling a trade-off for risk workshop facilitators. Methodologically, this approach overcomes limitations of prior research, specifically the lack of an assessment and process benchmark, the inability to disentangle multiple effects and the difficulty of capturing individual cognitive processes.
Details
Keywords
The main purpose of this study was to examine the relationship between student ratings and teacher ratings on a university-level writing assignment in order to investigate the…
Abstract
The main purpose of this study was to examine the relationship between student ratings and teacher ratings on a university-level writing assignment in order to investigate the extent to which students have the ability and wherewithal to accurately and reliably assess themselves on a finished writing product. The Pearson Product Moment coefficient was used to determine whether or not there was a statistical correlation between student scores and teacher scores while the Intra-Class Coefficient and Spearman Brown Prophecy formula were used to determine the degree of agreement between raters as well as amongst all of the raters for an average reliability score. In this case the results were very promising as it was found that student and teacher scores correlated very highly and demonstrated a strong degree of agreement. This suggests that self assessment may be used to assist students in this particular context to better understand the conventions of English writing and ultimately improve their overall writing ability.
Karen A. Tarnoff, Eric D. Bostwick and Kathleen J. Barnes
Faculty participation in the assurance of learning (AoL) is requisite both for the effective operation of the system and for accreditation compliance, but faculty often resist…
Abstract
Purpose
Faculty participation in the assurance of learning (AoL) is requisite both for the effective operation of the system and for accreditation compliance, but faculty often resist engaging in AoL tasks. The purpose of this paper is to provide specific recommendations to address faculty concerns and to guide AoL systems toward maturity.
Design/methodology/approach
This paper provides a comprehensive model of faculty resistance perspectives aligned to AoL maturity, provides specific responses to faculty resistance and introduces success markers of progress toward maturity.
Findings
Specifically, a three-stage model of AoL system maturity is presented and aligned with five faculty perspectives. For each faculty perspective, responses targeting causal factors are proposed and signs of progress toward the next level of faculty engagement are highlighted.
Practical implications
Faculty and AoL leaders will be able to identify their current stage of AoL system maturity and implement practical solutions to move to the next stage of system maturity.
Social implications
Understanding the motivations for faculty resistance will facilitate more meaningful and effective internal interactions as a school seeks to improve its AoL system. In turn, a more effective AoL system will promote better learning experiences for students; and better learning allows students to become productive in their chosen careers more quickly, thus improving society as a whole.
Originality/value
To the knowledge, no prior paper has organized faculty resistance along a maturity continuum, provided targeted responses based on the level of maturity or included signs that indicate growth toward the next level of maturity.
Details
Keywords
Maarit Aakko and Kirsi Niinimäki
Extending the active lifetimes of garments by producing better quality is a widely discussed strategy for reducing environmental impacts of the garment industry. While quality is…
Abstract
Purpose
Extending the active lifetimes of garments by producing better quality is a widely discussed strategy for reducing environmental impacts of the garment industry. While quality is an important aspect of clothing, the concept of quality is ambiguous, and, moreover, consumers may perceive quality in individual ways. Therefore, it is important to deepen the general understanding regarding the quality of clothing.
Design/methodology/approach
This paper presents an integrated literature review of the recent discussion of perceived quality of clothing and of the links between quality and clothing lifetimes; 47 selected articles and other literature obtained primarily through fashion/clothing/apparel journals were included in this review.
Findings
The main ideas from the articles are thematized into the following sections: the process of assessment, levels involved in assessment, multidimensional cues of assessment, and quality and clothing use times. The paper highlights that perceiving quality is a process guided by both expectations and experience, and assembles the various aspects into a conceptual map that depicts the connections between the conceptual levels involved in assessing quality. It also illustrates connections between quality and clothing use times.
Research limitations/implications
This paper focused on perceived quality on a conceptual level. Further studies could examine and establish deeper links between quality, sustainability and garment lifespans.
Originality/value
The study draws together studies on perceived quality, presenting the foundational literature and key concepts of quality of clothing. It summarizes them in a conceptual map that may help visualize various aspects affecting the assessment of quality and deepen the general understanding of the quality of garments.
Details