Search results
1 – 10 of over 13000Increased emphasis on offering quality education underscores the need for developing a rigorous process for assessing academic programs in higher education. In this chapter, we…
Abstract
Increased emphasis on offering quality education underscores the need for developing a rigorous process for assessing academic programs in higher education. In this chapter, we develop a practical and rigorous framework for comprehensive assessment of academic programs. This framework generates in-depth communication between the academic departments and the university administration. It provides a useful tool for advancing the university mission, setting priorities, allocating resources, and identifying future areas of potential growth. This data-driven framework covers a wide range of qualitative and quantitative variables. To ensure a smooth and efficient implementation of the assessment process we present the critical stages in the development of a successful program assessment framework − from determining the assessment criteria, establishing the organizational climate, appointing the assessment committee, preparing program self-studies, to collecting and analyzing data. We present real examples from the author’s home institution to illustrate and support the reader’s understanding of the framework.
Details
Keywords
Ya-Ping (Amy) Hsiao, Gerard van de Watering, Marthe Heitbrink, Helma Vlas and Mei-Shiu Chiu
In the Netherlands, thesis assessment quality is a growing concern for the national accreditation organization due to increasing student numbers and supervisor workload. However…
Abstract
Purpose
In the Netherlands, thesis assessment quality is a growing concern for the national accreditation organization due to increasing student numbers and supervisor workload. However, the accreditation framework lacks guidance on how to meet quality standards. This study aims to address these issues by sharing our experience, identifying problems and proposing guidelines for quality assurance for a thesis assessment system.
Design/methodology/approach
This study has two parts. The first part is a narrative literature review conducted to derive guidelines for thesis assessment based on observations made at four Dutch universities. The second part is a case study conducted in one bachelor’s psychology-related program, where the assessment practitioners and the vice program director analyzed the assessment documents based on the guidelines developed from the literature review.
Findings
The findings of this study include a list of guidelines based on the four standards. The case study results showed that the program meets most of the guidelines, as it has a comprehensive set of thesis learning outcomes, peer coaching for novice supervisors, clear and complete assessment information and procedures for both examiners and students, and a concise assessment form.
Originality/value
This study is original in that it demonstrates how to holistically ensure the quality of thesis assessments by considering the context of the program and paying more attention to validity (e.g. program curriculum and assessment design), transparency (e.g. integrating assessment into the supervision process) and the assessment expertise of teaching staff.
Details
Keywords
This study evaluated the impact of a faculty training program on student assessment using the Kirkpatrick model.
Abstract
Purpose
This study evaluated the impact of a faculty training program on student assessment using the Kirkpatrick model.
Design/methodology/approach
A self-reported survey assessed 111 Saudi and non-Saudi participants' satisfaction. Subjective and objective measures (self-reported measures, assessment literacy inventory and performance-based assessment tasks) gauged participants' learning level. Pre- and post-training data were collected from 2020 to 2022.
Findings
A highly significant effect on satisfaction (>80%) and learning levels was observed, as manifested by workplace practices of student assessment (>70%, the cut-off score). Pre- and post-training comparisons of participants' satisfaction and assessment literacy scores showed significant improvements following training. Multiple regression analyses showed no significant effects for gender and educational attainment but a substantial impact of academic cluster on participants' student assessment skills.
Research limitations/implications
Long-term effects of training faculty on assessment practices and student achievement will be studied at the institutional level in future research.
Practical implications
The current study contributes to human capital investment via faculty training on student assessment, helping them comply with assessment best practices. This assures the quality, fairness and consistency of assessment processes across disciplines in higher education institutions, enhances assessment validity and trust in educational services and may support institutional accreditation.
Social implications
This study provides opportunities for sharing best practices and helps establish a community of practice. It enhances learning outcomes achievement and empowers higher education graduates with attributes necessary to succeed in the labor market. The human capital investment may have a long-term impact on overall higher education quality.
Originality/value
This study contributes to the scarce literature investigating the impact of training faculty from different clusters on student assessment using subjective and objective measures. It provides developing and evaluating a long-term student assessment program following the Kirkpatrick model.
Details
Keywords
This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which…
Abstract
Purpose
This article focuses on the assessment of entrepreneurship competence by selected vocational teachers in Italy. The exploratory research question addresses the extent to which entrepreneurship assessments are competence based, and the research seeks to identify fully fledged assessment programmes with both a formative and summative component, and the use of assessment rubrics. It also explores the extent to which entrepreneurship competence is referred to in school documentation and later assessed, and the tools and strategies used for such assessment.
Design/methodology/approach
This case study is part of a larger European research project promoted by Cedefop; in Italy it focused on six selected vocational IVET and CVET programmes and apprenticeship schemes. It used a wide range of instruments to ensure triangulation and multiple perspectives: analysed policy documents and undertook online interviews with experts and policy makers. At VET providers' premises it deployed: analysis of school documents; observations of learning environments; interviews and focus groups with (in schools) teachers, directors and vice directors, learners and alumni (in companies) instructors, company tutors and employers, apprentices and alumni.
Findings
Assessment tasks were rarely embedded within fully fledged assessment programmes involving both formative and summative tasks, and assessment rubric for grading. Most of the time, entrepreneurship programmes lacked self-assessment, peer assessment and structured feedback and did not involve learners in the assessment process. Some instructors coached the students, but undertook no clear formative assessment. These findings suggest institutions have a testing culture with regard to assessment, at the level of both policy and practice. In most cases, entrepreneurship competence was not directly assessed, and learning outcomes were only loosely related to entrepreneurship.
Research limitations/implications
One limitation concerned the selection of the VET providers: these were chosen not on a casual basis, but because they ran programmes that were relevant to the development of entrepreneurship competence.
Practical implications
At the policy level, there is a need for new guidelines on competence development and assessment in VET, guidelines that are more aligned with educational research on competence development. To ensure the development of entrepreneurship competence, educators need in-service training and a community of practice.
Originality/value
So far, the literature has concentrated on entrepreneurship education at the tertiary level. Little is known about how VET instructors assess entrepreneurship competence. This study updates the picture of policy and practice in Italy, illustrating how entrepreneurship competence is developed in selected IVET and CVET programmes and apprenticeships.
Details
Keywords
Melaku Takele Abate, Abbi Lemma Wedajo and Adula Bekele Hunde
This study aimed at exploring mathematics teachers’ reactions, learning, school leaders’ support, and the use of the lesson study for transformative assessment (LSforTA) program…
Abstract
Purpose
This study aimed at exploring mathematics teachers’ reactions, learning, school leaders’ support, and the use of the lesson study for transformative assessment (LSforTA) program ideas in practice.
Design/methodology/approach
The LSforTA program was new and therefore, a local and grounded approach was needed to examine teachers’ knowledge and their skills acquired using LSforTA. A design-based research approach was therefore selected to evaluate and refine the LSforTA approach.
Findings
The program affected teachers’ practices of transformative assessment and enhanced their knowledge and skills in assessing students transformatively in a positive way. The paper concludes how LSforTA procedures were adapted in response to this evaluation and provides suggestions for future development and research.
Originality/value
With its original combination of conceptual and theoretical lenses, the research contributes to the academic literature by linking transformative assessment, lesson study and school context. This connection provides new opportunities for teachers to develop strategies to create meaningful assessment practices embedded with their instructional process in the context of their schools.
Details
Keywords
Melvin R. Weber, Craig Marshall, Sydney Pons and Ruth Annette Smith
The purpose of this research is two-fold: first, the researchers will create a reliable and valid hospitality senior exit survey by conducting a Delphi panel of experts and…
Abstract
Purpose
The purpose of this research is two-fold: first, the researchers will create a reliable and valid hospitality senior exit survey by conducting a Delphi panel of experts and second, the researchers will pilot-test the instrument with students from a four-year university. The data will be (a) assessed to determine the retention of knowledge by four-year students, (b) used by academicians to make changes to course material and (c) used to help with the accreditation assessment process.
Design/methodology/approach
A Delphi panel of hospitality educators was used to validate the items, and graduating hospitality students were used to calculate reliability.
Findings
By embracing the hospitality exit survey (HES), institutions can effectively evaluate and enhance their programs. With its ability to gauge students' knowledge retention, the study findings serve as a powerful tool for shaping the future of hospitality education.
Research limitations/implications
The study's findings might be somewhat limited in representing a broader range of perspectives within hospitality programs. Another limitation stems from the structure of the survey itself. The survey included numerous items requiring two inputs for each item. This format has the potential to introduce certain biases among participants.
Practical implications
In a positive statement, organizations can use this information to discover why employees stay and then continue to develop goals/strategies to ensure this process stays up to date. Academia is no different. Academia also wants to produce the best product, and since the students are to become the next set of leaders, these programs need to know what is successful and what needs to be adjusted.
Social implications
A strategic exit interview program should 1)Uncover issues relating to human resources/students; 2) understand employees'/students' perception of the work; 3) managers'/directors' leadership style and effectiveness; 4) human resource/college/departments benchmarks and 5) improve the organization.
Originality/value
This research holds significant importance as it focuses on developing the senior HES and its potential utilization within hospitality programs. The HES serves as a valuable tool for these programs to evaluate the knowledge levels of their graduating students and collect data necessary for assessment and accreditation purposes.
Details
Keywords
Salvatore Polizzi, Fabio Lupo and Sara Testella
Quality Assurance and Improvement Program (QAIP) is defined as “an ongoing and periodic assessment of the entire spectrum of audit and consulting work performed by the internal…
Abstract
Purpose
Quality Assurance and Improvement Program (QAIP) is defined as “an ongoing and periodic assessment of the entire spectrum of audit and consulting work performed by the internal audit (IA) activity”. QAIP is an important component of internal auditors’ commitment to improve internal audit (IA) quality. The pressure towards improvement is urgent for central banks, in light of the vulnerabilities of their IA functions identified by the International Monetary Fund. The authors analyse the professional standards and the literature on IA and QAIP, aiming to propose general considerations to enhance IA quality and to develop and maintain a QAIP, with reference to central banks, also shedding light on the synergies among IA, QAIP and total quality management (TQM).
Design/methodology/approach
This paper reviews the most relevant professional standards in light of the professional and academic literature regarding IA quality, QAIP and their relationship with TQM. The analysis of these sources represents an important step to identify general measures to improve IA quality and develop effective QAIP in central banks.
Findings
This analysis shows that it is important to understand the rationale behind the development of an IA function and its theoretical and practical foundation, especially for complex organisations such as central banks. In addition, the authors show that QAIP represents an important tool to exploit the synergies between TQM and IA. These synergies could result in higher levels of quality for the IA function and more effective implementation of TQM within the whole organisation. Lastly, the authors provide practical suggestions to support the implementation of an effective QAIP in central banks and to spread TQM philosophy within the organisation.
Originality/value
The authors contribute to the scant literature on IA quality and QAIP by focusing on central banks and shedding light on the relationship with TQM. Regardless of their importance, these topics have been largely neglected by the extant literature.
Details
Keywords
Tracy Mulvaney, Kathryn Lubniewski and Wendy Morales
Clinical practice provides teacher candidates with opportunities to link teaching and learning theory to practice in a supported environment with strong mentorship through their…
Abstract
Purpose
Clinical practice provides teacher candidates with opportunities to link teaching and learning theory to practice in a supported environment with strong mentorship through their initial phases of teaching. Teacher candidates wait in anticipation for the opportunity to get into classrooms to work alongside veteran teachers to promote student learning and achievement. This article presents one educator preparation program’s (EPP’s) innovative program that spans the boundaries of the USA to provide teacher candidates with a two-week intensive full-time clinical placement in schools located in the Cotswold Region of England.
Design/methodology/approach
Highlighted in this piece is the program’s partnership history, design, structure, connection to the nine essentials, assessment of program goals, and a synthesis of the literature on global education and its value in educator preparation.
Findings
Highlighted in this piece is the program’s partnership history, design, structure, connection to the nine essentials, assessment of program goals and a synthesis of the literature on global education and its value in educator preparation.
Originality/value
This article highlights one university’s innovation that places teacher candidates in the classroom for a two-week full-time immersive clinical experience in various schools in England. As early as their sophomore year, teacher candidates can participate in this study abroad program and do so while developing their own cultural competence and global citizenship.
Details
Keywords
Torbjørn Hekneby and Trude Høgvold Olsen
This paper aims to conceptualize the role of leadership in organizational learning processes in multinational companies (MNCs). The authors present a model describing how managers…
Abstract
Purpose
This paper aims to conceptualize the role of leadership in organizational learning processes in multinational companies (MNCs). The authors present a model describing how managers in an MNC facilitated transitions between sub-processes of organizational learning at several organizational levels.
Design/methodology/approach
The authors collected data from the plants of a global process company in Norway, Brazil and China. Observation, in-depth interviews and archival material enabled one to reconstruct the organizational learning process over a period of 30 years as the company developed its own tailor-made improvement programme.
Findings
Based on the data, the authors describe the role of leadership in linking the sub-processes of organizational learning as orchestration, sponsoring and persistence. Orchestration included creating faith and optimism and designing the organization to allow close cooperation between operators and managers in the sub-process of experimenting. This eased transferring and institutionalizing in the global organization. Sponsoring included structural changes to support transferring and the demonstration of dedication to improvement programme values. These factors were important for institutionalizing. Persistence involved the continuous focus on adjustment of the improvement programme, which then facilitated further experimenting.
Originality/value
Firstly, this study suggests that activities and decisions in one sub-process have important implications for the following sub-processes. Secondly, this study indicates that leaders’ role in facilitating the transitions between sub-processes extend beyond their individual traits and behaviour, which previous research had focused on, and includes decisions concerning organizational structure and culture that help link social and organizational learning.
Details