Search results

This study aims to focus on providing a computerized classification testing (CCT) system that can easily be embedded as a self-assessment feature into the existing legacy environment of a higher education institution, empowering students with self-assessments to monitor their learning progress and following strict data protection regulations. The purpose of this study is to investigate the use of two different versions (without dashboard vs with dashboard) of the CCT system during the course of a semester; to examine changes in the intended use and perceived usefulness of two different versions (without dashboard vs with dashboard) of the CCT system; and to compare the self-reported confidence levels of two different versions (without dashboard vs with dashboard) of the CCT system.

A total of N = 194 students from a higher education institution in the area of economic and business education participated in the study. The participants were provided access to the CCT system as an opportunity to self-assess their domain knowledge in five areas throughout the semester. An algorithm was implemented to classify learners into master and nonmaster. A total of nine metrics were implemented for classifying the performance of learners. Instruments for collecting co-variates included the study interest questionnaire (Cronbach’s a = 0. 90), the achievement motivation inventory (Cronbach’s a = 0. 94), measures focusing on perceived usefulness and demographic data.

The findings indicate that the students used the CCT system intensively throughout the semester. Students in a cohort with a dashboard available interacted more with the CCT system than students in a cohort without a dashboard. Further, findings showed that students with a dashboard available reported significantly higher confidence levels in the CCT system than participants without a dashboard.

The design of digitally supported learning environments requires valid formative (self-)assessment data to better support the current needs of the learner. While the findings of the current study are limited concerning one study cohort and a limited number of self-assessment areas, the CCT system is being further developed for seamless integration of self-assessment and related feedback to further reveal unforeseen opportunities for future student cohorts.

The purpose of this paper is to draw attention to the potential of “small data” to complement research in learning analytics (LA) and to share some of the insights learned from this approach.

This study demonstrates an approach inspired by design science research, making a dashboard available to n=1,905 students in 11 study programs (used by n=887) to learn how it is being used and to gather student feedback.

Students react positively to the LA dashboard, but usage and feedback differ depending on study success.

More research is needed to explore the expectations of a high-performing student with regards to LA dashboards.

This publication demonstrates how a small data approach to LA contributes to building a better understanding.

Nearly 40 years since they first appeared, there is renewed interest in dashboards, engendered by the diffusion of business intelligence (BI) desktop software, such as Power BI, QlikView and Tableau, denoted collectively as “self-service” BI. Using these commodity software tools, the work to construct dashboards apparently becomes easier and more manageable and no longer requires the intervention of specialists. This paper aims to analyse the implementation of this kind of commodity dashboard in a university, exploring its role in performance management processes and investigating whether the dashboard affects the organisation (or not).

This paper focusses on an action research project developed by the authors, where the objective was to design and implement a dynamic performance measurement tool fitting the needs of department directors. The three authors were all involved in the project, respectively, as project manager, dashboard implementation manager and accounting manager of the studied organisation.

The results reveal a specific but complex change to the procedures and outcomes in the organisation studied, where the dashboard becomes a boundary infrastructure, thereby reviving technical and organisational problems that had been latent for years.

In this paper, the authors contribute to the debate on the digital age and the role of accounting with their exploration into the “revolution” of self-service BI tools. The democratisation and flexibility of these instruments put into discussion two core and somewhat controversial functions of accounting: data integration and personalised reporting.

Many countries have a renewed focus on health inequalities since COVID-19. In England, integrated care systems (ICSs), formed in 2022 to promote integration, are required to reduce health inequalities. Integration is supported by population health management (PHM) which links data across health and care organisations to inform service delivery. It is not well-understood how PHM can help ICSs reduce health inequalities. This paper describes development of a programme theory to advance this understanding.

This study was conducted as a mixed-methods process evaluation in a local ICS using PHM. The study used Framework to analyse interviews with health and care professionals about a PHM tool, the COVID-19 vaccination uptake Dashboard. Quantitative data on staff Dashboard usage were analysed descriptively. To develop a wider programme theory, local findings were discussed with national PHM stakeholders.

ICS staff used PHM in heterogeneous ways to influence programme delivery and reduce inequalities in vaccine uptake. PHM data was most influential where it highlighted action was needed for “targetable” populations. PHM is more likely to influence decisions on reducing inequalities where data are trusted and valued, data platforms are underpinned by positive inter-organisational relationships and where the health inequality is a shared priority.

The COVID-19 pandemic accelerated a shift toward use of digital health platforms and integrated working across ICSs. This paper used an evaluation of integrated data to reduce inequalities in COVID-19 vaccine delivery to propose a novel programme theory for how integrated data can support ICS staff to tackle health inequalities.

This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education.

The application was developed using a design-based research (DBR) methodology. The application’s design was informed by a literature search and needs assessment of quality assurance stakeholders to ensure compliance with daily practices and accreditation requirements. Stakeholders from three study programmes evaluated the application.

As part of the development of the application, module- and programme-level dashboards were created to provide an overview of the programme’s outcomes, assessment methods, assessment metrics, self-evaluated quality indicators and assessment documents. The application was evaluated by stakeholders at the module and programme levels. Overall, the results indicated that the dashboards aided them in gaining insight into the assessment programme and its alignment with underlying assessments.

Visualisation of the assessment programme’s structure and content identifies gaps and opportunities for improvement, which can be used to initiate a dialogue and further actions to improve assessment quality.

The application developed facilitates a cyclical and transparent assessment quality assurance procedure that is continuously available to various stakeholders in quality assurance.

This paper aims to present findings from an EU-funded international student-led energy saving competition (SAVES) on a scale previously unseen. There are multiple accounts of short-term projects and energy saving competitions encouraging pro-environmental behaviour change amongst students in university dormitories, but the purpose of this research is to provide evidence of consistent and sustained energy savings from student-led energy savings competitions, underpinned by practical action.

A mixed-methods approach (pre- and post-intervention surveys, focus groups and analysis of energy meter data) was used to determine the level of energy savings and quantifiable behaviour change delivered by students across participating university dormitories.

This research has provided further insight into the potential for savings and behaviour change in university dormitories through relatively simple actions. Whilst other interventions have shown greater savings, this project provided consistent savings over two years of 7 per cent across a large number of university dormitories in five countries through simple behaviour changes.

An energy dashboard displaying near a real-time leaderboard was added to the engagement in the second year of the project. Whilst students were optimistic about the role that energy dashboards could play, the evidence is not here to quantify the impact of dashboards. Further research is required to understand the potential of dashboards to contribute to behavioural change savings and in constructing competitions between people and dormitories that are known to each other.

SAVES provided engagement with students, enabling, empowering and motivating them to save energy – focusing specifically on the last stage of the “Awareness, Interest, Desire, Action” framework. Automated meter reading data was used in the majority of participating dormitories to run near real-time energy challenges through an energy dashboard that informed students how much energy they saved compared to a target, and encouraged peer-to-peer learning and international cooperation through a virtual twinning scheme.

Findings from energy saving competitions in universities are typically from small-scale and short-term interventions. SAVES was an energy-saving competition in university dormitories facilitated by the UK National Union of Students in five countries reaching over 50,000 students over two academic years (incorporating dormitories at 17 universities). As such it provides clear and important evidence of the real-world long-term potential efficiency savings of such interventions.

The purpose of this paper is to evaluate four visualizations that represent affective states of students.

An empirical-experimental study approach was used to assess the usability of affective state visualizations in a learning context. The first study was conducted with students who had knowledge of visualization techniques (n=10). The insights from this pilot study were used to improve the interpretability and ease of use of the visualizations. The second study was conducted with the improved visualizations with students who had no or limited knowledge of visualization techniques (n=105).

The results indicate that usability, measured by perceived usefulness and insight, is overall acceptable. However, the findings also suggest that interpretability of some visualizations, in terms of the capability to support emotional awareness, still needs to be improved. The level of students’ awareness of their emotions during learning activities based on the visualization interpretation varied depending on previous knowledge of information visualization techniques. Awareness was found to be high for the most frequently experienced emotions and activities that were the most frustrating, but lower for more complex insights such as interpreting differences with peers. Furthermore, simpler visualizations resulted in better outcomes than more complex techniques.

Detection of affective states of students and visualizations of these states in computer-based learning environments have been proposed to support student awareness and improve learning. However, the evaluation of visualizations of these affective states with students to support awareness in real life settings is an open issue.