Search results

This research study seeks to identify what graduating students and alumni perceive to be of most value in courses, and in turn the relationship of those perceptions with the information in evaluations conducted by students at the conclusion of courses.

The project involves empirical research utilizing standard student course evaluation data, and rigorous matching alumni survey data. A focus group, as well as prior academic research, informs the design.

There are several key conclusions from this study comparing student and alumni perceptions of course satisfaction. Consistent with end‐of‐program survey and focus group observations, career relevance clearly grows with time in importance for determining course satisfaction. Career relevance is not a statistically significant factor for course satisfaction using end‐of‐course student survey responses, but grows to a statistically significant determinant utilizing alumni survey data, larger than both the extent of learning and instructor performance; moreover, instructor performance appears to become less important.

While survey responses for individuals as both students and alumni cannot be linked in this study, the high response rate of alumni and the pooling of data suggest results are robust.

If instructors want students, once they become alumni, to be satisfied with their course experience, they need to teach material which will be truly useful in their careers, even if students do not fully appreciate it during class. And if university presidents want satisfied alumni, they need to ensure their school's curriculum includes material that may be applied in the real world, and that the measures of teaching effectiveness utilized for compensation purposes do not stress too highly traditional measures of student satisfaction.

Educators can provide students with a more long‐term satisfying educational experience by ensuring curriculum includes practical material that is truly relevant for careers.

Student evaluations have been commonly used in determining the success of a course, and the effectiveness of their instructors. However, there has only been limited analysis of student evaluations as a measure of what matters most – the benefit to the student once they graduate and move into the working world. Empirical results based on student and alumni survey data identify differences in perceptions between students and alumni, and suggest key recommendations for both instructors and university administrators.

Teaching and unit evaluations surveys are used to assess the quality of teaching and the quality of the unit of study. An analysis of teaching and unit evaluation survey practices in Australian universities suggests significant changes. One key change discussed in the paper is the shift from voluntary to mandatory use of surveys with the results used to assess and reward academic staff performance. The change in the direction is largely driven by the introduction of performance‐based funding as part of quality assurance arrangements. The paper aims to outline the current trends and changes and the implications in the future such as increased scrutiny of teaching and intrusion to academic autonomy.

The paper is based on the analysis of current teaching and unit evaluation practices across the Australian university sector. The paper presents the case of an Australian university that has introduced performance‐based reward using various measures to assess and reward academic staff such as the outcome of student satisfaction surveys. The analysis of external quality audit findings related to teacher and unit evaluations is also presented.

The findings suggest a shift in trend from the use of voluntary to mandatory tools to assess and reward quality teaching. The case of an Australian university outlined in the paper and the approach taken by seven other universities is largely driven by performance‐based funding. One of the key concerns for many in higher education is the intrusion of academic autonomy with increased focus on outcomes and less emphasis on resources needed to produce excellence in learning and teaching and research. The increased reliance on student happiness as a measure of educational quality raises the questions on whether high student satisfaction would strengthen academic rigour and student attainment of learning outcomes and generic skills which are seen as key factors in graduate exit standards.

The renewal of quality assurance and performance‐based funding using student satisfaction as a measure of educational quality will result in increased use of student voice to assess learning and teaching outcomes. Such direction will increase the accountability on academics to improve student experience and the measures will be used to assess academic staff performance.

The paper outlines the trends and changes in the teacher and unit evaluations in Australian universities and its implications in the future. The paper also provides a case of an Australian university that has recently made teacher and unit evaluations compulsory with the results used in academic staff annual performance review and linking reward with performance outcomes.

From a service ecosystem perspective, the purpose of this paper is to examine students’ evaluation surveys as a tool used by most higher education (HE) institutions worldwide to measure teaching quality with consequences for tenure and promotion.

This study is based on the service-dominant (S-D) logic and specifically on the service ecosystem approach. Through an in-depth literature review and analysis the authors explore the effect of student evaluation surveys on the value co-creation process, describe the role they play in the HE ecosystem and critically evaluate their efficacy. The research is based on empirical data from the literature and previous studies findings.

The literature review highlights the detrimental consequences of the use of students’ evaluation surveys for teachers and students and for the rest of actors of this service. The authors argue that institutions should embrace a service ecosystem perspective based on S-D logic. The authors highlight the role of institutions as moderators of the interactions between actors and, finally, the authors have introduced the concept of “service ecosystem pollution” which the authors define as the presence or introduction of disruptive elements in the service ecosystem adversely affecting the nature of value co-creation.

This study emphasizes the importance for HE institutions to embrace a service ecosystem approach so as to foster and preserve the value co-creation processes taking place within the interactions among the HE actors. Conclusions drawn from this paper suggest that HE institutions should focus on strategies such as investing in improving students’ and teachers’ operant resources rather than polluting the HE service ecosystem with the use of students’ evaluation surveys.

Hitherto there are no studies analyzing the tools HE institutions use to measure teaching quality from a service ecosystem perspective. The study is especially valuable due to the consequences and the use of these measures entails for teachers, students and society.

This paper aims to provide an introductory overview and selected annotated bibliography of recent resources on library instruction and information literacy across all library types.

It introduces and annotates English-language periodical articles, monographs, dissertations and other materials on library instruction and information literacy published in 2014.

It provides information about each source, discusses the characteristics of current scholarship and highlights sources that contain unique or significant scholarly contributions.

The information may be used by librarians and interested parties as a quick reference to literature on library instruction and information literacy.

The purpose of this paper is to analyse student satisfaction as identified in the UK National Student Survey (NSS) at an institutional level in one post-1992 UK university, to discuss the perceived factors behind changes in NSS results and to identify the possible impact of institutional-level quality enhancement interventions.

The paper reviews some of the literature available on the NSS, teaching evaluation and on learning and teaching leadership in higher education and demonstrates by comparison with practice how different approaches to change management were experienced.

Over a period of eight years within one HEI, it was possible to identify four distinct phases of NSS scores and to identify strong trends in both quantitative and qualitative results.

It is postulated that evidence-informed institutional-level interventions in learning and teaching practice can have an impact on the external evaluation of student satisfaction when they are part of a coherent strategy. However, although some aspects of the work are generalisable to other contexts, it is also recognised that individual environments and experiences will impact on outcomes.

This paper argues, first, that the NSS could be as much an indicator of organisational culture as a measure of student satisfaction with courses; second, that areas that students highlight as being important tend to be consistent and third, that regardless of the foci or type of interventions, senior staff level engagement is a critical factor in achieving high NSS scores and enhancing student satisfaction.

The paper will be valuable to those using the NSS for quality enhancement at a strategic level.

The COVID-19 pandemic has brought about a contingent shift to remote working and learning worldwide. However, little is known regarding the impact of this shift on internships. Moreover, much of the available literature studies on internships are focused largely on perceptions by students, less so by supervisors. This paper describes the impact of COVID-19 on public health (PH) internships and examines interns' and supervisors' perspectives on their experiences in internships before and during the pandemic.

A cross-sectional study design was conducted on two cohorts of undergraduate students and their supervisors in Singapore. Participants were surveyed using questionnaires with both close-ended and open-ended questions about various aspects of the internship experience. Data were triangulated from these surveys and module evaluation reports, and analyzed quantitatively and qualitatively.

COVID-19 disrupted internships significantly, with a reduction in the number of placements offered and necessary changes to the internship scope. Overall, the internship experience has been positive. Supervisors and e-interns reported high levels of satisfaction and documented learning gains such as the development of technical skills and soft skills unique to remote work.

The study findings fill current gaps in the literature on supervisor perceptions and internship experiences during COVID-19. Recommendations are proposed to optimize e-internships, a potentially authentic workplace in the post-COVID era.

This study sought to determine the effect of class size on the evaluation of teaching effectiveness for on‐line courses using a standard student evaluation survey instrument. The data set consists of all MBA courses taught online during an academic year at a large, regional Midwestern university in the U.S. Several simple regression analyses are performed with class size as the independent variable. Dependent variables analysed were global course effectiveness and summated indices representing “building blocks” of online effectiveness. These include course content, instructor support, course structure, student‐to‐student interaction and instructor to‐student interaction. Results indicate no significant relationship between class size and global course effectiveness. In addition, class size showed some significance in predicting instructor support and course structure. Unexpectedly the direction of this association was positive suggesting that larger classes lead to higher levels of instructor support and greater perceived course structure. A comparison to traditional courses is also provided.

Though we live in a digital era, libraries offer significant hours of in-person reference services, in combination with online reference services. Nevertheless, an increase in requests for in-person, individualized research consultations (IRCs) over the last few years has been observed. IRCs between librarians and students are common practice in academic institutions. While these sessions can be deemed useful for patrons, as they are tailored to their specific needs, however, they can also be time consuming for the librarians. Therefore, it is important to evaluate this service, and assess its impact in order to ensure that the users are getting the most out of their sessions. The purpose of this paper is to gather information on the evaluation and assessment tools that Canadian institutions are using to obtain feedback, measure their impact and improve their consultation services.

A bilingual (French and English) web-based questionnaire was issued, with a generic definition of IRCs provided. The questionnaire included general demographics and background information on IRC practices among Canadian academic librarians, followed by reflective questions on the assessment process of such practices. The questionnaire was sent to Canadian academic librarians via e-mail, using professional librarian associations’ listservs, and Twitter was used for dissemination as well.

Major findings of the survey concluded that the disciplines of health sciences and medicine, as well as the arts and humanities are the heaviest users of the IRC service model. On average, these sessions are one hour in length, provided by librarians who often require advanced preparation time to adequately help the user, with infrequent follow-up appointments. It was not surprising that a lack of assessment methods for IRCs was identified among Canadian academic libraries. Most libraries have either no assessment in place for IRCs, or they rely heavily on informal feedback from users, comments from faculty members and so on. A small portion of libraries use usage statistics to assess their IRCs service, but other means of assessment are practically non-existent.

The survey conducted was only distributed to Canadian academic libraries. Institutions across the USA and other countries that also perform IRCs may have methods for evaluating and assessing these sessions which the authors did not gather; therefore, the evidence is biased. As well, each discipline approaches IRCs very differently; therefore, it is challenging to compare the evaluation and assessment methods between each discipline. Furthermore, the study’s population is unknown, as the authors did not know the exact number of librarians or library staff providing IRCs by appointment in academic Canadian institution. While the response rate was reasonably good, it is impossible to know if the sample is representative of the population. Also, it needs to be acknowledged that the study is exploratory in nature as this is the first study solely dedicated at examining academic librarians’ IRC practices. Further research is needed. As future research is needed to evaluate and assess IRCs with an evidence-based approach, the authors will be conducting a pre-test and post-test to assess the impact of IRC on students’ search techniques.

Evidence-based practice for IRCs is limited. Very few studies have been conducted examining the evaluation and assessment methods of these sessions; therefore, it was believed that a “lay of the land,” so to speak, was needed. The study is exploratory in nature, as this is the first study solely dedicated at examining the evaluation and assessment methods of academic librarians’ IRC practices.

The aim of this research is to determine the importance and impact of project-based learning (PBL) on students' knowledge in Lean and Six Sigma courses where practical application of theoretical knowledge is necessary.

Students teams were given hands-on collaborative projects conducted with local companies. After the completion of the project, a student evaluation survey was conducted and the responses were analysed in two different phases. The first phase consisted of collecting responses from the Lean and Six Sigma courses; observing the impact of the semester project on students' knowledge based on the response percentages. The second phase analyses the responses from both the Lean and Six Sigma courses, by performing a Fisher's exact test to examine how similar the students received knowledge from the use of the semester project.

Results showed that the inclusion of the semester project in the courses had a positive impact on the students' knowledge in learning course concepts and the students were able to apply theoretical knowledge in solving real-world problems. It is also observed that the response patterns are different in most of the aspects between both the courses.

This research evaluates student learning with statistical tests and is limited only for classroom teaching techniques. Further, this research states that application-oriented courses should be accompanied by projects as it helps in better understanding the course deliverables for the students.

Research evaluating the impact of PBL on students' knowledge in Lean and Six Sigma courses does not currently exist. Statistical analysis of survey responses from both the Lean and Six Sigma courses was performed using a χ2 test of independence to examine how similar the students received knowledge from the use of the semester project.

The main purpose of this paper is twofold: to present a proposal for a model of educational quality management system within a process approach context for technical universities, and a conceptual model of a performance measurement system (PMS) towards the assessment of the quality level of management, core and support processes.

The paper encompasses two main parts: a theoretical portion and a case study. Within the theoretical background, the authors discuss the issue of educational quality management supported on a process approach perspective as well as performance measurement system in high education (HE). The case study reports the development of the concept of performance measurement system for technical universities.

The proposed system of educational quality management supported on a process approach, together with a conceptual model of the performance measurement system, can be implemented in every technical university. The identification of processes in the education quality management system permitted the development of the PMS. The model covers 32 key performance indicators (KPIs) for management processes, 39 for core processes and 19 for supporting ones.

The proposed performance measurement system is limited in its focus on educational processes and support of these processes. The evaluation of scientific and research activity and aspects related to financial resources is not pursued.

Elaboration of a conceptual model of a performance measurement system towards the assessment of the quality level of management, core and support processes is dedicated to technical universities.