Search results
1 – 10 of 318Dirk Ifenthaler and Muhittin ŞAHİN
This study aims to focus on providing a computerized classification testing (CCT) system that can easily be embedded as a self-assessment feature into the existing legacy…
Abstract
Purpose
This study aims to focus on providing a computerized classification testing (CCT) system that can easily be embedded as a self-assessment feature into the existing legacy environment of a higher education institution, empowering students with self-assessments to monitor their learning progress and following strict data protection regulations. The purpose of this study is to investigate the use of two different versions (without dashboard vs with dashboard) of the CCT system during the course of a semester; to examine changes in the intended use and perceived usefulness of two different versions (without dashboard vs with dashboard) of the CCT system; and to compare the self-reported confidence levels of two different versions (without dashboard vs with dashboard) of the CCT system.
Design/methodology/approach
A total of N = 194 students from a higher education institution in the area of economic and business education participated in the study. The participants were provided access to the CCT system as an opportunity to self-assess their domain knowledge in five areas throughout the semester. An algorithm was implemented to classify learners into master and nonmaster. A total of nine metrics were implemented for classifying the performance of learners. Instruments for collecting co-variates included the study interest questionnaire (Cronbach’s a = 0. 90), the achievement motivation inventory (Cronbach’s a = 0. 94), measures focusing on perceived usefulness and demographic data.
Findings
The findings indicate that the students used the CCT system intensively throughout the semester. Students in a cohort with a dashboard available interacted more with the CCT system than students in a cohort without a dashboard. Further, findings showed that students with a dashboard available reported significantly higher confidence levels in the CCT system than participants without a dashboard.
Originality/value
The design of digitally supported learning environments requires valid formative (self-)assessment data to better support the current needs of the learner. While the findings of the current study are limited concerning one study cohort and a limited number of self-assessment areas, the CCT system is being further developed for seamless integration of self-assessment and related feedback to further reveal unforeseen opportunities for future student cohorts.
Details
Keywords
Tom Broos, Katrien Verbert, Greet Langie, Carolien Van Soom and Tinne De Laet
The purpose of this paper is to draw attention to the potential of “small data” to complement research in learning analytics (LA) and to share some of the insights learned from…
Abstract
Purpose
The purpose of this paper is to draw attention to the potential of “small data” to complement research in learning analytics (LA) and to share some of the insights learned from this approach.
Design/methodology/approach
This study demonstrates an approach inspired by design science research, making a dashboard available to n=1,905 students in 11 study programs (used by n=887) to learn how it is being used and to gather student feedback.
Findings
Students react positively to the LA dashboard, but usage and feedback differ depending on study success.
Research limitations/implications
More research is needed to explore the expectations of a high-performing student with regards to LA dashboards.
Originality/value
This publication demonstrates how a small data approach to LA contributes to building a better understanding.
Details
Keywords
Michela Arnaboldi, Andrea Robbiani and Paola Carlucci
Nearly 40 years since they first appeared, there is renewed interest in dashboards, engendered by the diffusion of business intelligence (BI) desktop software, such as Power BI…
Abstract
Purpose
Nearly 40 years since they first appeared, there is renewed interest in dashboards, engendered by the diffusion of business intelligence (BI) desktop software, such as Power BI, QlikView and Tableau, denoted collectively as “self-service” BI. Using these commodity software tools, the work to construct dashboards apparently becomes easier and more manageable and no longer requires the intervention of specialists. This paper aims to analyse the implementation of this kind of commodity dashboard in a university, exploring its role in performance management processes and investigating whether the dashboard affects the organisation (or not).
Design/methodology/approach
This paper focusses on an action research project developed by the authors, where the objective was to design and implement a dynamic performance measurement tool fitting the needs of department directors. The three authors were all involved in the project, respectively, as project manager, dashboard implementation manager and accounting manager of the studied organisation.
Findings
The results reveal a specific but complex change to the procedures and outcomes in the organisation studied, where the dashboard becomes a boundary infrastructure, thereby reviving technical and organisational problems that had been latent for years.
Originality/value
In this paper, the authors contribute to the debate on the digital age and the role of accounting with their exploration into the “revolution” of self-service BI tools. The democratisation and flexibility of these instruments put into discussion two core and somewhat controversial functions of accounting: data integration and personalised reporting.
Details
Keywords
Georgia Watson, Cassie Moore, Fiona Aspinal, Andrew Hutchings, Rosalind Raine and Jessica Sheringham
Many countries have a renewed focus on health inequalities since COVID-19. In England, integrated care systems (ICSs), formed in 2022 to promote integration, are required to…
Abstract
Purpose
Many countries have a renewed focus on health inequalities since COVID-19. In England, integrated care systems (ICSs), formed in 2022 to promote integration, are required to reduce health inequalities. Integration is supported by population health management (PHM) which links data across health and care organisations to inform service delivery. It is not well-understood how PHM can help ICSs reduce health inequalities. This paper describes development of a programme theory to advance this understanding.
Design/methodology/approach
This study was conducted as a mixed-methods process evaluation in a local ICS using PHM. The study used Framework to analyse interviews with health and care professionals about a PHM tool, the COVID-19 vaccination uptake Dashboard. Quantitative data on staff Dashboard usage were analysed descriptively. To develop a wider programme theory, local findings were discussed with national PHM stakeholders.
Findings
ICS staff used PHM in heterogeneous ways to influence programme delivery and reduce inequalities in vaccine uptake. PHM data was most influential where it highlighted action was needed for “targetable” populations. PHM is more likely to influence decisions on reducing inequalities where data are trusted and valued, data platforms are underpinned by positive inter-organisational relationships and where the health inequality is a shared priority.
Originality/value
The COVID-19 pandemic accelerated a shift toward use of digital health platforms and integrated working across ICSs. This paper used an evaluation of integrated data to reduce inequalities in COVID-19 vaccine delivery to propose a novel programme theory for how integrated data can support ICS staff to tackle health inequalities.
Details
Keywords
Lonneke H. Schellekens, Marieke F. van der Schaaf, Cees P.M. van der Vleuten, Frans J. Prins, Saskia Wools and Harold G.J. Bok
This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in…
Abstract
Purpose
This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education.
Design/methodology/approach
The application was developed using a design-based research (DBR) methodology. The application’s design was informed by a literature search and needs assessment of quality assurance stakeholders to ensure compliance with daily practices and accreditation requirements. Stakeholders from three study programmes evaluated the application.
Findings
As part of the development of the application, module- and programme-level dashboards were created to provide an overview of the programme’s outcomes, assessment methods, assessment metrics, self-evaluated quality indicators and assessment documents. The application was evaluated by stakeholders at the module and programme levels. Overall, the results indicated that the dashboards aided them in gaining insight into the assessment programme and its alignment with underlying assessments.
Practical implications
Visualisation of the assessment programme’s structure and content identifies gaps and opportunities for improvement, which can be used to initiate a dialogue and further actions to improve assessment quality.
Originality/value
The application developed facilitates a cyclical and transparent assessment quality assurance procedure that is continuously available to various stakeholders in quality assurance.
Details
Keywords
Richard Bull, Joanna Romanowicz, Neil Jennings, Marina Laskari, Graeme Stuart and Dave Everitt
This paper aims to present findings from an EU-funded international student-led energy saving competition (SAVES) on a scale previously unseen. There are multiple accounts of…
Abstract
Purpose
This paper aims to present findings from an EU-funded international student-led energy saving competition (SAVES) on a scale previously unseen. There are multiple accounts of short-term projects and energy saving competitions encouraging pro-environmental behaviour change amongst students in university dormitories, but the purpose of this research is to provide evidence of consistent and sustained energy savings from student-led energy savings competitions, underpinned by practical action.
Design/methodology/approach
A mixed-methods approach (pre- and post-intervention surveys, focus groups and analysis of energy meter data) was used to determine the level of energy savings and quantifiable behaviour change delivered by students across participating university dormitories.
Findings
This research has provided further insight into the potential for savings and behaviour change in university dormitories through relatively simple actions. Whilst other interventions have shown greater savings, this project provided consistent savings over two years of 7 per cent across a large number of university dormitories in five countries through simple behaviour changes.
Research limitations/implications
An energy dashboard displaying near a real-time leaderboard was added to the engagement in the second year of the project. Whilst students were optimistic about the role that energy dashboards could play, the evidence is not here to quantify the impact of dashboards. Further research is required to understand the potential of dashboards to contribute to behavioural change savings and in constructing competitions between people and dormitories that are known to each other.
Social implications
SAVES provided engagement with students, enabling, empowering and motivating them to save energy – focusing specifically on the last stage of the “Awareness, Interest, Desire, Action” framework. Automated meter reading data was used in the majority of participating dormitories to run near real-time energy challenges through an energy dashboard that informed students how much energy they saved compared to a target, and encouraged peer-to-peer learning and international cooperation through a virtual twinning scheme.
Originality/value
Findings from energy saving competitions in universities are typically from small-scale and short-term interventions. SAVES was an energy-saving competition in university dormitories facilitated by the UK National Union of Students in five countries reaching over 50,000 students over two academic years (incorporating dormitories at 17 universities). As such it provides clear and important evidence of the real-world long-term potential efficiency savings of such interventions.
Details
Keywords
Leony Derick, Gayane Sedrakyan, Pedro J. Munoz-Merino, Carlos Delgado Kloos and Katrien Verbert
The purpose of this paper is to evaluate four visualizations that represent affective states of students.
Abstract
Purpose
The purpose of this paper is to evaluate four visualizations that represent affective states of students.
Design/methodology/approach
An empirical-experimental study approach was used to assess the usability of affective state visualizations in a learning context. The first study was conducted with students who had knowledge of visualization techniques (n=10). The insights from this pilot study were used to improve the interpretability and ease of use of the visualizations. The second study was conducted with the improved visualizations with students who had no or limited knowledge of visualization techniques (n=105).
Findings
The results indicate that usability, measured by perceived usefulness and insight, is overall acceptable. However, the findings also suggest that interpretability of some visualizations, in terms of the capability to support emotional awareness, still needs to be improved. The level of students’ awareness of their emotions during learning activities based on the visualization interpretation varied depending on previous knowledge of information visualization techniques. Awareness was found to be high for the most frequently experienced emotions and activities that were the most frustrating, but lower for more complex insights such as interpreting differences with peers. Furthermore, simpler visualizations resulted in better outcomes than more complex techniques.
Originality/value
Detection of affective states of students and visualizations of these states in computer-based learning environments have been proposed to support student awareness and improve learning. However, the evaluation of visualizations of these affective states with students to support awareness in real life settings is an open issue.
Details
Keywords
Matthias Kuhnel, Luisa Seiler, Andrea Honal and Dirk Ifenthaler
The purpose of the study was to test the usability of the MyLA app prototype by its potential users. Furthermore, the Web app will be introduced in the framework of “Mobile…
Abstract
Purpose
The purpose of the study was to test the usability of the MyLA app prototype by its potential users. Furthermore, the Web app will be introduced in the framework of “Mobile Learning Analytics”, a cooperation project between the Cooperative State University Mannheim and University of Mannheim. The participating universities focus on the support of personalized and self-regulated learning. MyLA collects data such as learning behavior, as well as personality traits. Last but not least, the paper will contribute to the topic of learning analytics and mobile learning in higher education.
Design/methodology
For the empirical investigation, a mixed-method design was chosen. While 105 participants took part in the conducted online survey, after testing the app prototype, seven students joined an additional eye tracking study. For the quantitative part, a selected question pool from HIMATT (highly integrated model assessment technology and tools) instrument was chosen. The eye tracking investigation consisted of three tasks the participants had to solve.
Findings
The findings showed that the students assessed the idea of the app, as well as the navigation positively. Only the color scheme of the prototype was not very attractive to a noticeable amount of the participants. So, it requires slight modifications concerning the app design. For the eye tracking study, it can be stated that the students viewed the relevant parts, and they basically had no difficulties to solve the tasks.
Originality/value
Due to the empirical testing of the app prototype, the project team was able to adjust the application and to add further features. Furthermore, the backend was programmed and an additional tool (MyLA dashboard) was developed for lecturers. A mutual understanding of the targets, privacy issue and relevant features are indispensable for further development of the project.
Details
Keywords
Siddarth Nair, Abhishek Kaushik and Harnaik Dhoot
Skills form an integral part of an organization for its efficient functioning. This research study investigates mechanisms to actively persuade employees and organizations to…
Abstract
Skills form an integral part of an organization for its efficient functioning. This research study investigates mechanisms to actively persuade employees and organizations to change their attitudes and perspectives towards skills through the design and implementation of a skill-based system. The aim of the project is to know if we can create a skill-focused climate in a software organization through a software system proposed by the researcher and if such a system will help in utilizing in-house employees for new opportunities rather than hiring new employees. Feedback was collected on the proposed skill-based system from software professionals and human resource managers through an online survey. Findings reveal that the proposed skill-based system will create a skill-focused climate in a software organization and also help in better utilization of internal employees for new skill requirements rather than directly hiring external employees.
Details
Keywords
Vincenzo Corvello, Monica De Carolis, Saverino Verteramo and Annika Steiber
This paper explores digital transformation's impact on the work of owners in entrepreneurial firms. The interplay between working practices and technology is analyzed, taking into…
Abstract
Purpose
This paper explores digital transformation's impact on the work of owners in entrepreneurial firms. The interplay between working practices and technology is analyzed, taking into account the organizations' specific contexts.
Design/methodology/approach
A multiple case study design was applied. Eight cases of entrepreneurial firms, defined as companies that bring new products and services to the market by creating and seizing opportunities, were selected, with the goal to maximize the diversity of cases. The sample includes both small- and medium-sized firms, as well as high- tech and low- tech companies in equal number. Interviews have been used to collect both quantitative and qualitative data, which was analyzed in a structured way.
Findings
The digital transformation of entrepreneurial work, that is the daily work of entrepreneurs, is an evolutionary, practice-based phenomenon, rather than the result of rational design. The use of different digital tools is interrelated and depends on the characteristics, and dynamics of the surrounding environment.
Practical implications
The findings of this study are relevant to entrepreneurs interested in understanding the dynamics of their working practice, to software development firms interested in entrepreneurs as customers and to institutions interested in the education of entrepreneurs.
Originality/value
To the best of the authors' knowledge this is the first study which considers the interplay between digital technology and the daily activities of entrepreneurs, considered as a whole. It provides insights on how these interconnected dimensions evolve, thus contributing to understanding the work of entrepreneurs, and as a consequence the dynamics of entrepreneurial firms in the context of digital transformation of organizations.
Details