Search results
1 – 10 of 777John Garger, Paul H. Jacques, Brian W. Gastle and Christine M. Connolly
The purpose of this paper is to demonstrate that common method variance, specifically single-source bias, threatens the validity of a university-created student assessment of…
Abstract
Purpose
The purpose of this paper is to demonstrate that common method variance, specifically single-source bias, threatens the validity of a university-created student assessment of instructor instrument, suggesting that decisions made from these assessments are inherently flawed or skewed. Single-source bias leads to generalizations about assessments that might influence the ability of raters to separate multiple behaviors of an instructor.
Design/methodology/approach
Exploratory factor analysis, nested confirmatory factor analysis and within-and-between analysis are used to assess a university-developed, proprietary student assessment of instructor instrument to determine whether a hypothesized factor structure is identifiable. The instrument was developed over a three-year period by a university-mandated committee.
Findings
Findings suggest that common method variance, specifically single-source bias, resulted in the inability to identify hypothesized constructs statistically. Additional information is needed to identify valid instruments and an effective collection method for assessment.
Practical implications
Institutions are not guaranteed valid or useful instruments even if they invest significant time and resources to produce one. Without accurate instrumentation, there is insufficient information to assess constructs for teaching excellence. More valid measurement criteria can result from using multiple methods, altering collection times and educating students to distinguish multiple traits and behaviors of individual instructors more accurately.
Originality/value
This paper documents the three-year development of a university-wide student assessment of instructor instrument and carries development through to examining the psychometric properties and appropriateness of using this instrument to evaluate instructors.
Details
Keywords
Jill Tomasson Goodwin, Joslin Goh, Stephanie Verkoeyen and Katherine Lithgow
The purpose of this paper is to report on research findings from a teaching and learning intervention that explored whether undergraduate university students can be taught to…
Abstract
Purpose
The purpose of this paper is to report on research findings from a teaching and learning intervention that explored whether undergraduate university students can be taught to articulate their employability skills effectively to prospective employers and to retain this ability post-course.
Design/methodology/approach
The study included 3,400 students in 44 courses at a large Canadian university. Stage 1 involved a course-level teaching and learning intervention with the experimental student group, which received employability skills articulation instruction. Stage 2 involved an online survey administered six months post-course to the experimental group and the control group. Both groups responded to two randomly generated questions using the Situation/Task, Actions, Result (STAR) format, a format that employers commonly rely on to assess job candidates’ employability skills. The researchers compared the survey responses from the experimental and control groups.
Findings
Survey results demonstrate that previous exposure to the STAR format was the only significant factor affecting students’ skills articulation ability. Year of study and program (co-operative or non-co-operative) did not influence articulation.
Practical implications
The findings suggest that universities should integrate institution-wide, course-level employability skills articulation assignments for students in all years of study and programs (co-op and non-co-op).
Originality/value
This research is novel because its study design combines practical, instructional design with empirical research of significant scope (institution-wide) and participant size (3,400 students), contributing quantitative evidence to the employability skills articulation discussion. By surveying students six months post-course, the study captures whether articulation instruction can be recalled, an ability of particular relevance for career preparedness.
Details
Keywords
In this paper a systematic and well-defined student participation assessment scheme for college courses is proposed. The scheme supports the involvement of students in a variety…
Abstract
In this paper a systematic and well-defined student participation assessment scheme for college courses is proposed. The scheme supports the involvement of students in a variety of areas of participation within and outside the classroom with the aim of improving their learning. The scheme addresses mostly the challenges related to the practicality of the structure and design of the assessment. It also addresses the subjectivity of grading student participations. Areas of participation are widened to allow the faculty more accurate information about the conduct of each individual student towards more objective assessment. In addition, it provides the faculty with the flexibility to select areas that best fit the learning outcomes, nature of the course, availability of time and resources, and class atmosphere. The proposed scheme is initiated and developed using feedback from the teaching staff of Nizwa College of Technology, (NCT) through a survey and open discussion. The results indicate that over two thirds of the surveyed staff show agreement with the concept of assessing participation and find the scheme design clear and systematic, while 82% of them perceive the scheme as effective in improving the motivation and learning of students.
Competition among higher education institutions has pushed universities to expand their competitive advantages. Based on the assumption that the core functions of universities are…
Abstract
Purpose
Competition among higher education institutions has pushed universities to expand their competitive advantages. Based on the assumption that the core functions of universities are academic, understanding the teaching–learning process with the help of student evaluation of teaching (SET) would seem to be a logical solution in increasing competitiveness. The paper aims to discuss these issues.
Design/methodology/approach
The current paper presents a narrative literature review examining how SETs work within the concept of service marketing, focusing specifically on the search, experience, and credence qualities of the provider. A review of the various factors that affect the collection of SETs is also included.
Findings
Relevant findings show the influence of students’ prior expectations on SET ratings. Therefore, teachers are advised to establish a psychological contract with the students at the start of the semester. Such an agreement should be negotiated, setting out the potential benefits of undertaking the course and a clear definition of acceptable performance within the class. Moreover, connections should be made between courses and subjects in order to provide an overall view of the entire program together with future career pathways.
Originality/value
Given the complex factors affecting SETs and the antecedents involved, there appears to be no single perfect tool to adequately reflect what is happening in the classroom. As different SETs may be needed for different courses and subjects, options such as faculty self-evaluation and peer-evaluation might be considered to augment current SETs.
Details
Keywords
Institutional and commercial web profiles that provide biobibliographic information about researchers are used for promotional purposes but also as information sources. In the…
Abstract
Purpose
Institutional and commercial web profiles that provide biobibliographic information about researchers are used for promotional purposes but also as information sources. In the latter case, the profiles' (re)presentations of researchers may be used to assess whether a researcher can be trusted. The article introduces a conceptual framework of how trust in researchers may be formed based on how the researchers' experiences and achievements are mobilized on the profiles to tell a multifaceted story of the “self.”
Design/methodology/approach
The framework is an analytical product which draws on theories of trust as well as on previous research focused on academic web profiles and on researchers' perceptions of trust and credibility. Two dimensions of trust are identified as central to the theoretical construction of trust, namely competence and trustworthiness.
Findings
The framework outlines features of profile content and narrative that may influence the assessment of the profile and of the researcher's competence and trustworthiness. The assessment is understood as shaped by the frames of interpretation available to a particular audience.
Originality/value
The framework addresses the lack of a trust perspective in previous research about academic web profiles. It provides an analysis of how potential trust in the researcher may be formed on the profiles. An innovative contribution is the acknowledgement of both qualitative and quantitative indicators of trustworthiness and competence, including the richness of the story told about the “self.”
Details
Keywords
This uses quantitative and qualitative methods in assessing performance and process outcomes in a team lecture hybrid (TLH) instructional design applied in a public affairs course.
Abstract
Purpose
This uses quantitative and qualitative methods in assessing performance and process outcomes in a team lecture hybrid (TLH) instructional design applied in a public affairs course.
Design/methodology/approach
Within a non-experimental prospective design, individual and team outcomes were assessed as follows: survey of student perceptions of learning outcomes; comparison of individual and group scores on in-class case analyses using paired t-tests; external reviewers' observations of traditional lecture versus TLH activities; and analysis of students' reflections on team dynamics using a team process reflection tool adapted from four team development stages.
Findings
The following student learning outcomes results were observed: increased use of critical thinking; higher student interaction with other students and the instructor; higher student engagement in initiating or contributing to content or other learning activities; higher student enthusiasm; increased use of problem-solving skills; improved performance evidenced by quality of individual versus group products; evidence suggesting improvements in student learning outcomes when active learners and an active instructor interact in a learning environment.
Practical implications
Instructor practice tips were provided in the following areas: use of assessment methods; student engagement as an active instructor; motivational tips for classes with students from a variety of disciplines; and individual team member accountability.
Originality/value
This paper contributes to the scholarship of teaching and learning (SOTL) by addressing limitations in both traditional and collaborative learning models and expanding holistic evaluations in SOTL.
Details
Keywords
Elena Casprini, Tommaso Pucci, Niccolò Fiorini and Lorenzo Zanni
Focusing on the adoption of Total Quality Management (TQM) principles in universities, this research paper explores how the “soft” dimensions of TQM trigger its “hard” dimensions…
Abstract
Purpose
Focusing on the adoption of Total Quality Management (TQM) principles in universities, this research paper explores how the “soft” dimensions of TQM trigger its “hard” dimensions considering them at the individual (micro-) and the university (meso-), and eventually at cluster (system-), levels.
Design/methodology/approach
Adopting a qualitative approach, this study presents an in-depth, longitudinal case study of University of Siena, one of the oldest Italian universities, that has been at the core of the research-based cluster on vaccines, today converged in the Tuscan Life Science Cluster. In particular, data were collected between 2018 and February 2022 and consists of archival data (press articles, websites, books), nine interviews to key informants, multiyear experience of the Life Sciences sector by two of the authors and other material put at disposal by university offices, and emails. Data analysis relied on a timeline, a coding procedure that considered three levels of analysis (individual, organization and cluster). Finally, the authors looked at the “how” and “why” the emerged themes have contributed to academic excellence.
Findings
This paper unveils how “soft” and “hard” sides of TQM are blended across multiple levels for reaching academic excellence. The grounded model emerged enlightens the importance of an individual “soft” dimension, academic passion (composed by its three subdimensions of individual research, teaching and entrepreneurial passion) and also sheds light on the organizational “soft” and “hard” sides that the university has been able to design for encouraging research, teaching and third mission quality. Academic excellence has been possible thanks to the capitalization of the individual and organizational “soft” sides into real outcomes as represented by the organizational and individual “hard” sides.
Practical implications
The paper suggests the importance of TQM principles applied at universities' level, providing an in-depth description of “soft” and “hard” sides dimensions of TQM and their impact on all the three pillars of academic excellence. The study findings suggest implications for managers and professionals in the higher education domain as well as for policymakers emphasizing the importance of supporting the individual and organizational soft sides of TQM. The authors provide practical implications recommending universities to consider not only the organizational dimensions but also individual ones when pursuing higher education excellence. In particular, individual passion plays a crucial role and universities need to identify ways of nurturing it. The authors also recommend policymakers to think about new ways to sustain universities as crucial actors in boosting a cluster development, as well as to consider higher education institutions, especially in more rural areas, as a privileged player not only capable of nurturing academic excellence but also able of creating an internationally renowned cluster.
Originality/value
TQM principles have been intensively analysed from an industrial perspective focusing on manufacturing and services, while this paper focuses on TQM in universities, presenting a grounded model that blends the individual and organizational “soft” and “hard” sides.
Details
Keywords
Arindam Chakrabarty and Anil Kumar Singh
India has been withstanding increasing pressure of enrolment in the higher education system, resulting in the creation of new universities in consonance with the recommendations…
Abstract
Purpose
India has been withstanding increasing pressure of enrolment in the higher education system, resulting in the creation of new universities in consonance with the recommendations of the Knowledge Commission (2007). Barring a few institutions of paramount excellence, the mushrooming universities fail to conform to equitability of quality and standards, that is teaching-learning-dissemination and research, except for accommodating higher gross enrolment ratio. It has resulted in an asymmetric and sporadic development of human resources, leaving a large basket of learners out of the pursuit for aspiring higher academic, research and professional enrichment. The country needs to develop an innovative common minimum curriculum and evaluation framework, keeping in view the trinity of diversity, equity and inclusion (DEI) across the Indian higher education system to deliver human resources with equitable knowledge, skill and intellectual acumen.
Design/methodology/approach
The paper has been developed using secondary information.
Findings
The manuscript has developed an innovative teaching-learning framework that would ensure every Indian HEI to follow a common minimum curriculum and partial common national evaluation system so that the learners across the country would enjoy the essence of equivalence.
Originality/value
This research has designed a comprehensive model to integrate the spirit of the “DEI” value proposition in developing curriculum and gearing common evaluation. This would enable the country to reinforce the spirit of social equity and the capacity to utilise resources with equitability and perpetuity.
Details
Keywords
The purpose of this paper is to look at how employability is currently embedded within courses to prepare students for their transition into the world of work, identifying the…
Abstract
Purpose
The purpose of this paper is to look at how employability is currently embedded within courses to prepare students for their transition into the world of work, identifying the teaching and learning strategies employed.
Design/methodology/approach
A review of the relevant literature was conducted. The study analysed experiential data and the logged reports of student work placements over a period of five years, to determine the relationship of such placements to both academic results and long term employability. The study considered placements from the viewpoints of the university, students and employers. It proceeded to look at the current embedding of employability within the teaching curriculum, specifically teaching and learning strategies for personal professional development courses and the employability passport. It also looked at the role of the work placement tutor.
Findings
The main revelation was that the employability skills sought by employers were mostly “soft” and therefore behaviours, rather than “hard” teachable skills, which has significant implications for the introduction of the teaching excellence framework (TEF) and the provision of suitable metrics.
Research limitations/implications
The study and findings are limited to a single university in the UK.
Originality/value
The results of the study and conclusions drawn from the analysis of findings, led to the identification of the student, institution, tutor, employer) quartet of actors for employability. The paper also postulates the ramifications of the introduction of the TEF on employability.
Details
Keywords
Tashmin Khamis, Azra Naseem, Anil Khamis and Pammla Petrucka
The purpose of this research is to focus on work-based problems catalysed by the COVID-19 global pandemic, based on a case study of a multi-continental, multi-campus university…
Abstract
Purpose
The purpose of this research is to focus on work-based problems catalysed by the COVID-19 global pandemic, based on a case study of a multi-continental, multi-campus university distributed across Kenya, Tanzania, Uganda and Pakistan. Higher education institutions (HEIs) in developing countries lacked pre-existing infrastructure to support online education and/or policy and regulatory frameworks during the pandemic. The university's programmes in Pakistan and East Africa provide lessons to other developing countries' HEIs. The university's focus on teaching and learning and staff development has had a transformational organisational effect.
Design/methodology/approach
Case study with participatory approaches aimed at co-production of responsive systems and co-creation of effective curriculum and faculty training is used.
Findings
Systems and processes developed across the university in the effort to ensure educational continuity. From the disruption to all educational programmes and the disarray of regulatory bodies' responses, collaboration emerged as a key driver of positive change. The findings reiterate the value of trust and provision of opportunities for those with the requisite competencies to lead in a participatory and distributive manner whilst addressing limited human and financial resources. The findings reflect on previous work respecting organisational change recast in the digital age.
Originality/value
This paper reflects the authors' work in real-time as they led and managed changes encountered during the COVID-19 pandemic. The paper will be of value to management and leadership cadres, particularly in developing contexts, responsible for recovery and sustainability of the higher education sector.
Details