Search results

1 – 10 of over 5000
Article
Publication date: 26 July 2021

Choon Yong Alex Tan, Kye Mon Min Swe and Veronica Poulsaeman

The purpose of this case study is to share the authors’ involvement and observation in adopting online exam as an evaluation tool, in the hope that others may too be able to adapt…

1596

Abstract

Purpose

The purpose of this case study is to share the authors’ involvement and observation in adopting online exam as an evaluation tool, in the hope that others may too be able to adapt and circumvent this lockdown period while bringing a more reliable methodological approach in an online exam.

Design/methodology/approach

This is a case study that reports the application of an online examination for a year 3 MBBS Professional Exam during the period of lockdown (movement control). This case highlights the conduct of online theory in the form of single best answer multiple choice questions and online practical via objective structured clinical examination, without jeopardizing the integrity of the system, and the measures adapted to mitigate potential academic dishonesty.

Findings

The authors’ observation shows that online exam can be conducted in scenario where conventional exam is not possible.

Research limitations/implications

This is an observation in a real-life scenario that discusses the purpose and the process. A single study may not be sufficient to relate the reliability and generalizability of the analysis.

Practical implications

The practice of social distancing is a hindrance towards traditional classroom teaching. Online exam has promising potential to be the solution to this problem. The authors have demonstrated that an MBBS theory and practical exam can be conducted remotely without any physical contact, without any compromise in achieving the learning objectives within the curriculum. Medical education can proceed with a new drive while ensuring the learning process continues a stable momentum.

Originality/value

Online examination is almost unheard of, especially for undergraduates in the medical programme. This study highlights a plausible approach in the design of the online examination and identifies the barriers and favourable edges of this platform.

Details

Quality Assurance in Education, vol. 29 no. 4
Type: Research Article
ISSN: 0968-4883

Keywords

Content available
Article
Publication date: 12 May 2021

Jiyou Jia and Yunfan He

The purpose of this study is to design and implement an intelligent online proctoring system (IOPS) by using the advantage of artificial intelligence technology in order to…

1757

Abstract

Purpose

The purpose of this study is to design and implement an intelligent online proctoring system (IOPS) by using the advantage of artificial intelligence technology in order to monitor the online exam, which is urgently needed in online learning settings worldwide. As a pilot application, the authors used this system in an authentic university online exam and checked the proctoring result.

Design/methodology/approach

The IOPS adopts the B/S (Browser/Server) architecture. The server side is implemented with programming language C and Python and stores the identification data of all examinees and their important behavior change status, including facial expression, eye and mouth movement and speech. The browser side collects and analyzes multimodal data of the examinee writing the online test locally and transfers the examinee’s most important behavior status change data to the server. Real-time face recognition and voice detection are implemented with the support of open-source software.

Findings

The system was integrated into a Web-based intelligent tutoring system for school mathematics education. As a pilot application, the system was also used for online proctored exam in an undergraduate seminar in Peking University during the epidemic period in 2020. The recorded log data show that all students concentrated themselves on the exam and did not leave the camera and did not speak.

Originality/value

During the epidemic period of the novel coronavirus outbreak, almost all educational institutions in the world use online learning as the best way to maintain the teaching and learning schedule for all students. However, current online instruction platforms lack the function to prevent the learners from cheating in online exams and cannot guarantee the integrity and equality for all examinees as in traditional classroom exams. The literature review shows that the online proctoring system should become an important component of online exams to tackle the growing online cheating problem. Although such proctoring systems have been developed and put on the market, the practical usage of such systems in authentic exams and its effect have not been reported. Those systems are heavyweight and commercial product and cannot be freely used in education. The light-weight IOPS developed by the authors could meet the need for online exam as a stable and practical approach and could contribute to the growing online learning and distance learning.

Details

Interactive Technology and Smart Education, vol. 19 no. 1
Type: Research Article
ISSN: 1741-5659

Keywords

Book part
Publication date: 11 January 2016

Ann Boyd Davis, Richard Rand and Robert Seay

As more students take online courses as part of their college curricula, the integrity of testing in an online environment becomes increasingly important. The potential for…

Abstract

Purpose

As more students take online courses as part of their college curricula, the integrity of testing in an online environment becomes increasingly important. The potential for cheating on exams is generally considered to be higher in an online environment. One approach to compensate for the absence of a physical proctor is to use a remote proctoring service that electronically monitors the student during the examination period.

Methodology/approach

We examined the exam grades for 261 students taking two different upper division accounting courses to determine if a computer-based remote proctoring service reduced the likelihood of cheating, measured through lower exam scores, as compared to classroom proctoring and no proctoring. We examined both online and on-campus courses.

Findings

In qualitative and quantitative accounting courses, evidence shows that grades were significantly lower for students who were proctored using a remote proctoring service compared to students who were not proctored. In the quantitative course, remote proctoring resulted in significantly lower final exam scores than either classroom or no proctoring. However, in the qualitative course, both remote proctoring online and live proctoring in a classroom resulted in significantly lower final exam scores than no proctoring, and they are not statistically different from each other.

Originality/value

Academics and administrators should find these results helpful. The results suggest that the use of proctoring services in online courses has the potential to enhance the integrity of online courses by reducing the opportunities for academic dishonesty during exams.

Details

Advances in Accounting Education: Teaching and Curriculum Innovations
Type: Book
ISBN: 978-1-78560-767-7

Keywords

Open Access
Article
Publication date: 17 August 2023

Shengnan Han, Shahrokh Nikou and Workneh Yilma Ayele

To improve the academic integrity of online examinations, digital proctoring systems have recently been implemented in higher education institutions (HEIs). The paper aims to…

1713

Abstract

Purpose

To improve the academic integrity of online examinations, digital proctoring systems have recently been implemented in higher education institutions (HEIs). The paper aims to understand how digital proctoring has been practised in higher education (HE) and proposes future research directions for studying digital proctoring in HE.

Design/methodology/approach

A systematic literature review was conducted. The PRISMA procedure was adapted for the literature search. The topics were identified by topic modelling techniques from 154 relevant publications in seven databases.

Findings

Seven widely discussed topics in literature were identified, including solutions for detecting cheating and student authentication, challenges/issues of uptakes and students' performance in different proctoring environments.

Research limitations/implications

This paper provides insights for academics, policymakers, practitioners and students to understand the implementation of digital proctoring in academia, its adoption by HEIs, impacts on students' and educators' performance and the rapid increase in its use for digital exams in HEIs, with particular emphasis on the impacts of the systems on digitalising examinations in HE.

Originality/value

This review paper has systematically and critically described the state-of-the-art literature on digital proctoring in HE and provides useful insights and implications for future research on digital proctoring, and how academic integrity in online examinations can be enhanced, along with digitalising HE.

Details

International Journal of Educational Management, vol. 38 no. 1
Type: Research Article
ISSN: 0951-354X

Keywords

Article
Publication date: 9 November 2023

Shard, Devesh Kumar and Sapna Koul

This study aims to gain insights into how students perceive online examination practices and evaluation, as well as identify the key factors that impact their intentions toward…

Abstract

Purpose

This study aims to gain insights into how students perceive online examination practices and evaluation, as well as identify the key factors that impact their intentions toward online exams.

Design/methodology/approach

This empirical study conducted in India utilized an online survey method between May 24 and June 14, 2022. The data were collected from 712 undergraduate and postgraduate students through a Google Docs questionnaire. Descriptive analysis, exploratory factor analysis (EFA), regression and reliability analysis were conducted to analyze the data.

Findings

There are many studies related to the adoption of online learning. However, there are limited studies that explore the adoption and acceptance of online examinations and evaluations. This paper intends to fill this gap and tries to highlight important factors influencing online examination usage by the students. Five important factors emerged in the study include “pedagogy, validity, reliability,” “practicality,” “security,” “facilitating condition” and “intention,” The study concludes that taking tests online is preferred for several reasons, including the perceived increased dependability of grades and the decreased cost, time and effort associated with taking exams.

Research limitations/implications

This research explores students' perceptions of learning management systems (LMS)-based online exams and provides insights for students to better prepare and adapt. It assists policymakers in developing fair assessment policies and improving LMS platforms. The study contributes to the theoretical understanding of e-learning and calls for further research to enhance the effectiveness of online exams. It identifies gaps in existing literature and recommends larger sample sizes, broader representation, longitudinal data collection and conversational methods for future research.

Originality/value

This study shows increasing research on e-learning and online examinations, mostly using quantitative methods. The important variables for understanding students' perceptions of online exams are “pedagogy, validity, reliability,” “practicality,” “security,” “facilitating condition” and “intention.” Concerns raised include validity, fairness and security. Electronic exams are more suitable for formative evaluation, and validity, reliability, security and adaptability are key pillars for successful online testing.

Details

The International Journal of Information and Learning Technology, vol. 41 no. 1
Type: Research Article
ISSN: 2056-4880

Keywords

Article
Publication date: 7 December 2020

Amanda White

The purpose of this paper is to reflect on the shift of assessments online and the potential impact on academic integrity and misconduct. The rapid pivot to online teaching as a…

1228

Abstract

Purpose

The purpose of this paper is to reflect on the shift of assessments online and the potential impact on academic integrity and misconduct. The rapid pivot to online teaching as a result of COVID19 and our experiences in the accounting academy is the embodiment of the phrase “may you live in interesting times”. As teaching and learning activities shifted online, so did assessment of student learning. A topic of great discussion amongst faculty is whether accounting exams should be invigilated online and whether exams should be used at all to assess student learning.

Design/methodology/approach

This paper uses personal reflections and experiences to analyse the tensions between the risk of academic misconduct, maintaining assessment security and accreditation requirements of professional accounting bodies during the shift of assessment tasks online in 2020. These tensions are analysed using the fraud triangle framework (Cressey, 1973).

Findings

Students face incentives and pressures to engage in misconduct, opportunities that arise from online learning and assessment, and hold complex perceptions around their attitudes towards academic integrity and rationalisations of misconduct behaviour.

Originality/value

Suggestions are made as to how the accounting academy can move forward, taking advantages of online assessment, while still ensuring that our graduates are meeting the competencies required to join the accounting profession.

Details

Accounting Research Journal, vol. 34 no. 3
Type: Research Article
ISSN: 1030-9616

Keywords

Article
Publication date: 20 July 2023

Isuru Koswatte, Chandrika Fernando and Nirma Sadamali Jayawardena

Higher educational institutes (HEIs) are experiencing a significant shift towards online education, which has been fast-forwarded with the global pandemic of COVID-19. The forced…

Abstract

Purpose

Higher educational institutes (HEIs) are experiencing a significant shift towards online education, which has been fast-forwarded with the global pandemic of COVID-19. The forced shift has also exposed many vulnerabilities in online education, especially assessments. The purpose of this study is to investigate the potential dark side of the digital transformation of examinations through the lens of university students.

Design/methodology/approach

This study involves a sample of 127 university students from the fields of business and science, technology, education and management (STEM) and the key factors affecting student perception were assessed quantitatively to explore the interrelationships.

Findings

Results revealed that both business and STEM students have a similar impression of the use of online examinations, and the majority still have mixed feelings about them as a replacement for physical examinations. The regrouping of the factors revealed two key dimensions, trustworthiness and apprehensible education, as key areas of student perception in the context of online examinations.

Research limitations/implications

This study aims to strengthen the understanding of Kolb’s experiential learning mechanism through a discussion on the importance of abstract conceptualization as opposed to concrete experience in the establishment of the online assessment and learning space. Practically speaking, increasing investment in internet infrastructure and forming strategic alliances with important parties, like internet providers, to create uninterrupted network coverage, are an effective place to start if one wants to make sure that the process of moving to online learning is becoming more and more accepted by educators, students, and the general public.

Originality/value

The online transition to higher education has seen expedited growth since the pandemic and has not given much room for many HEIs globally to adjust. The procedures and techniques implemented take a Western lens, and less attention is given to the emerging context and its context-specific characteristics in such implementation. This study takes the theoretical lens of Kolb and proposes the key learnings for a successful online transition to assessment in emerging contexts.

Details

VINE Journal of Information and Knowledge Management Systems, vol. 53 no. 5
Type: Research Article
ISSN: 2059-5891

Keywords

Article
Publication date: 9 June 2021

Sri Astuti and Diki Rukmana

The covid-19 pandemic that hit the world has caused several changes in the higher education service sector, including the implementation of the undergraduate thesis examination…

Abstract

Purpose

The covid-19 pandemic that hit the world has caused several changes in the higher education service sector, including the implementation of the undergraduate thesis examination, where direct interaction between students and examiners is avoided and replacing it with an online bachelor thesis exam. This study aims to develop a conceptual model regarding the variables that can affect student satisfaction with the quality of the implementation of online undergraduate thesis examinations in higher education.

Design/methodology/approach

The research instrument consisted of 22 survey questions distributed to 583 students taking the thesis trial examination in the even semester of 2019/2020 who came from 12 different study programs. Factor analysis and structural equation modeling (SEM) were conducted to analyze the validity of the instrument and test the hypothesis. The results of the analysis show that the 22 instrument items used have been determined by sufficient variables to check the structure of each.

Findings

SEM analysis results show that the three hypothesized variables (study program service, examiner performance and quality of video conference applications) positively and significantly affect the level of student satisfaction with the online undergraduate thesis examination 0.187, 0.177 and 0.177, respectively. The total effect of these three factors is 0.737.

Research limitations/implications

This finding is a reference for those who want to improve the quality of the online undergraduate thesis examination in higher education.

Originality/value

As the online thesis examination was implemented in higher education in Indonesia as a result of the implementation of the study and work at home policy by the Indonesian Ministry of Education, it is important to conduct research on the implementation of online thesis exams in Indonesia, especially to study the conceptual model of variables affect student satisfaction with the implementation of the online thesis exam. Because even though the implementation of online thesis exams on a large scale is new to some higher education in Indonesia.

Details

Quality Assurance in Education, vol. 29 no. 4
Type: Research Article
ISSN: 0968-4883

Keywords

Article
Publication date: 25 April 2022

Irshad Ali, Anil K. Narayan and Dilani Gedera

The aim of this paper is to provide insights into challenges and opportunities in transforming assessment of learning in accounting education from established practices to…

Abstract

Purpose

The aim of this paper is to provide insights into challenges and opportunities in transforming assessment of learning in accounting education from established practices to technology-based methods. 10; 10;

Design/methodology/approach

This reflective commentary is based on personal reflections and experiences of three senior academics from the same university on the accelerated utilisation of online assessment in accounting education due to COVID-19. Further information was obtained from document analysis, informal conversations with colleagues and observations.

Findings

The findings of this paper suggest that despite numerous challenges, online assessments may replace traditional face-to-face assessments such as tests and exams in accounting and if done properly, this could drive significant improvements in student learning and outcomes. Institutions need to invest in appropriate technology, provide appropriate staff training and ensure good online assessment design that incorporates principles of authenticity and fairness. Robust online assessment practices need to be integrated with e-proctoring systems to ensure academic integrity is upheld.

Practical implications

The paper provides functional insights to higher education management, teaching staff and other stakeholders such as professional accreditation bodies on challenges and opportunities in utilising online assessments. It offers guidance to educators on transforming assessment of learning using the power of technology.

Originality/value

The ideas in this paper are original. The paper shares our lived experiences in transforming established assessment practices in accounting courses to align with online teaching and learning due to COVID-19.

Details

Pacific Accounting Review, vol. 34 no. 4
Type: Research Article
ISSN: 0114-0582

Keywords

Article
Publication date: 24 October 2022

Neelima Madugula, Srikanth Allamsetty, Abhinav Sinha, Subhendu Mishra, M.V. Satya Sai Chandra and Dhanya Krishnan

With the current COVID-19 outbreak, the majority of the higher educational institutes (HEI) are conducting online examinations to assess their students, where both teachers and…

Abstract

Purpose

With the current COVID-19 outbreak, the majority of the higher educational institutes (HEI) are conducting online examinations to assess their students, where both teachers and students are facing various constraints. Under these circumstances, it is very important to understand the perspectives of teachers and students towards online examinations in higher education institutions and the factors affecting their perspectives.

Design/methodology/approach

This study has been conducted with the mentioned objective through online survey responses and rigorous statistical analysis of the data. The data analysis has been performed and presented using self-explanatory bar graphs, partial least squares structural equation modeling (PLS-SEM) and sentiment analysis.

Findings

While the students responded diversely for items in one of the constructs: scope for malpractice, the teachers agreed with the items, indicating that the online exams are not sufficiently effective in dealing with cheating and malpractice. Few more issues related to Internet connections, short time duration for uploading answer scripts are identified as problems and need attention while framing the rules to conduct the online examinations in future.

Originality/value

A new questionnaire was drafted to measure the effect of different constructs. An attempt is made to understand the perspectives of both the teachers and the students towards online examinations with respect to each of these considered constructs with a rigorous statistical analysis.

Details

Journal of Applied Research in Higher Education, vol. 15 no. 4
Type: Research Article
ISSN: 2050-7003

Keywords

1 – 10 of over 5000