Search results

1 – 10 of 318
Open Access
Article
Publication date: 12 May 2023

Dirk Ifenthaler and Muhittin ŞAHİN

This study aims to focus on providing a computerized classification testing (CCT) system that can easily be embedded as a self-assessment feature into the existing legacy…

Abstract

Purpose

This study aims to focus on providing a computerized classification testing (CCT) system that can easily be embedded as a self-assessment feature into the existing legacy environment of a higher education institution, empowering students with self-assessments to monitor their learning progress and following strict data protection regulations. The purpose of this study is to investigate the use of two different versions (without dashboard vs with dashboard) of the CCT system during the course of a semester; to examine changes in the intended use and perceived usefulness of two different versions (without dashboard vs with dashboard) of the CCT system; and to compare the self-reported confidence levels of two different versions (without dashboard vs with dashboard) of the CCT system.

Design/methodology/approach

A total of N = 194 students from a higher education institution in the area of economic and business education participated in the study. The participants were provided access to the CCT system as an opportunity to self-assess their domain knowledge in five areas throughout the semester. An algorithm was implemented to classify learners into master and nonmaster. A total of nine metrics were implemented for classifying the performance of learners. Instruments for collecting co-variates included the study interest questionnaire (Cronbach’s a = 0. 90), the achievement motivation inventory (Cronbach’s a = 0. 94), measures focusing on perceived usefulness and demographic data.

Findings

The findings indicate that the students used the CCT system intensively throughout the semester. Students in a cohort with a dashboard available interacted more with the CCT system than students in a cohort without a dashboard. Further, findings showed that students with a dashboard available reported significantly higher confidence levels in the CCT system than participants without a dashboard.

Originality/value

The design of digitally supported learning environments requires valid formative (self-)assessment data to better support the current needs of the learner. While the findings of the current study are limited concerning one study cohort and a limited number of self-assessment areas, the CCT system is being further developed for seamless integration of self-assessment and related feedback to further reveal unforeseen opportunities for future student cohorts.

Details

Interactive Technology and Smart Education, vol. 20 no. 3
Type: Research Article
ISSN: 1741-5659

Keywords

Open Access
Article
Publication date: 3 July 2017

Tom Broos, Katrien Verbert, Greet Langie, Carolien Van Soom and Tinne De Laet

The purpose of this paper is to draw attention to the potential of “small data” to complement research in learning analytics (LA) and to share some of the insights learned from…

1719

Abstract

Purpose

The purpose of this paper is to draw attention to the potential of “small data” to complement research in learning analytics (LA) and to share some of the insights learned from this approach.

Design/methodology/approach

This study demonstrates an approach inspired by design science research, making a dashboard available to n=1,905 students in 11 study programs (used by n=887) to learn how it is being used and to gather student feedback.

Findings

Students react positively to the LA dashboard, but usage and feedback differ depending on study success.

Research limitations/implications

More research is needed to explore the expectations of a high-performing student with regards to LA dashboards.

Originality/value

This publication demonstrates how a small data approach to LA contributes to building a better understanding.

Details

Journal of Research in Innovative Teaching & Learning, vol. 10 no. 2
Type: Research Article
ISSN: 2397-7604

Keywords

Open Access
Article
Publication date: 1 December 2020

Michela Arnaboldi, Andrea Robbiani and Paola Carlucci

Nearly 40 years since they first appeared, there is renewed interest in dashboards, engendered by the diffusion of business intelligence (BI) desktop software, such as Power BI…

2430

Abstract

Purpose

Nearly 40 years since they first appeared, there is renewed interest in dashboards, engendered by the diffusion of business intelligence (BI) desktop software, such as Power BI, QlikView and Tableau, denoted collectively as “self-service” BI. Using these commodity software tools, the work to construct dashboards apparently becomes easier and more manageable and no longer requires the intervention of specialists. This paper aims to analyse the implementation of this kind of commodity dashboard in a university, exploring its role in performance management processes and investigating whether the dashboard affects the organisation (or not).

Design/methodology/approach

This paper focusses on an action research project developed by the authors, where the objective was to design and implement a dynamic performance measurement tool fitting the needs of department directors. The three authors were all involved in the project, respectively, as project manager, dashboard implementation manager and accounting manager of the studied organisation.

Findings

The results reveal a specific but complex change to the procedures and outcomes in the organisation studied, where the dashboard becomes a boundary infrastructure, thereby reviving technical and organisational problems that had been latent for years.

Originality/value

In this paper, the authors contribute to the debate on the digital age and the role of accounting with their exploration into the “revolution” of self-service BI tools. The democratisation and flexibility of these instruments put into discussion two core and somewhat controversial functions of accounting: data integration and personalised reporting.

Details

Journal of Accounting & Organizational Change, vol. 17 no. 1
Type: Research Article
ISSN: 1832-5912

Keywords

Open Access
Article
Publication date: 28 November 2023

Georgia Watson, Cassie Moore, Fiona Aspinal, Andrew Hutchings, Rosalind Raine and Jessica Sheringham

Many countries have a renewed focus on health inequalities since COVID-19. In England, integrated care systems (ICSs), formed in 2022 to promote integration, are required to…

Abstract

Purpose

Many countries have a renewed focus on health inequalities since COVID-19. In England, integrated care systems (ICSs), formed in 2022 to promote integration, are required to reduce health inequalities. Integration is supported by population health management (PHM) which links data across health and care organisations to inform service delivery. It is not well-understood how PHM can help ICSs reduce health inequalities. This paper describes development of a programme theory to advance this understanding.

Design/methodology/approach

This study was conducted as a mixed-methods process evaluation in a local ICS using PHM. The study used Framework to analyse interviews with health and care professionals about a PHM tool, the COVID-19 vaccination uptake Dashboard. Quantitative data on staff Dashboard usage were analysed descriptively. To develop a wider programme theory, local findings were discussed with national PHM stakeholders.

Findings

ICS staff used PHM in heterogeneous ways to influence programme delivery and reduce inequalities in vaccine uptake. PHM data was most influential where it highlighted action was needed for “targetable” populations. PHM is more likely to influence decisions on reducing inequalities where data are trusted and valued, data platforms are underpinned by positive inter-organisational relationships and where the health inequality is a shared priority.

Originality/value

The COVID-19 pandemic accelerated a shift toward use of digital health platforms and integrated working across ICSs. This paper used an evaluation of integrated data to reduce inequalities in COVID-19 vaccine delivery to propose a novel programme theory for how integrated data can support ICS staff to tackle health inequalities.

Details

Journal of Integrated Care, vol. 31 no. 4
Type: Research Article
ISSN: 1476-9018

Keywords

Open Access
Article
Publication date: 29 November 2022

Lonneke H. Schellekens, Marieke F. van der Schaaf, Cees P.M. van der Vleuten, Frans J. Prins, Saskia Wools and Harold G.J. Bok

This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in…

1667

Abstract

Purpose

This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education.

Design/methodology/approach

The application was developed using a design-based research (DBR) methodology. The application’s design was informed by a literature search and needs assessment of quality assurance stakeholders to ensure compliance with daily practices and accreditation requirements. Stakeholders from three study programmes evaluated the application.

Findings

As part of the development of the application, module- and programme-level dashboards were created to provide an overview of the programme’s outcomes, assessment methods, assessment metrics, self-evaluated quality indicators and assessment documents. The application was evaluated by stakeholders at the module and programme levels. Overall, the results indicated that the dashboards aided them in gaining insight into the assessment programme and its alignment with underlying assessments.

Practical implications

Visualisation of the assessment programme’s structure and content identifies gaps and opportunities for improvement, which can be used to initiate a dialogue and further actions to improve assessment quality.

Originality/value

The application developed facilitates a cyclical and transparent assessment quality assurance procedure that is continuously available to various stakeholders in quality assurance.

Details

Quality Assurance in Education, vol. 31 no. 2
Type: Research Article
ISSN: 0968-4883

Keywords

Open Access
Article
Publication date: 18 October 2018

Richard Bull, Joanna Romanowicz, Neil Jennings, Marina Laskari, Graeme Stuart and Dave Everitt

This paper aims to present findings from an EU-funded international student-led energy saving competition (SAVES) on a scale previously unseen. There are multiple accounts of…

2631

Abstract

Purpose

This paper aims to present findings from an EU-funded international student-led energy saving competition (SAVES) on a scale previously unseen. There are multiple accounts of short-term projects and energy saving competitions encouraging pro-environmental behaviour change amongst students in university dormitories, but the purpose of this research is to provide evidence of consistent and sustained energy savings from student-led energy savings competitions, underpinned by practical action.

Design/methodology/approach

A mixed-methods approach (pre- and post-intervention surveys, focus groups and analysis of energy meter data) was used to determine the level of energy savings and quantifiable behaviour change delivered by students across participating university dormitories.

Findings

This research has provided further insight into the potential for savings and behaviour change in university dormitories through relatively simple actions. Whilst other interventions have shown greater savings, this project provided consistent savings over two years of 7 per cent across a large number of university dormitories in five countries through simple behaviour changes.

Research limitations/implications

An energy dashboard displaying near a real-time leaderboard was added to the engagement in the second year of the project. Whilst students were optimistic about the role that energy dashboards could play, the evidence is not here to quantify the impact of dashboards. Further research is required to understand the potential of dashboards to contribute to behavioural change savings and in constructing competitions between people and dormitories that are known to each other.

Social implications

SAVES provided engagement with students, enabling, empowering and motivating them to save energy – focusing specifically on the last stage of the “Awareness, Interest, Desire, Action” framework. Automated meter reading data was used in the majority of participating dormitories to run near real-time energy challenges through an energy dashboard that informed students how much energy they saved compared to a target, and encouraged peer-to-peer learning and international cooperation through a virtual twinning scheme.

Originality/value

Findings from energy saving competitions in universities are typically from small-scale and short-term interventions. SAVES was an energy-saving competition in university dormitories facilitated by the UK National Union of Students in five countries reaching over 50,000 students over two academic years (incorporating dormitories at 17 universities). As such it provides clear and important evidence of the real-world long-term potential efficiency savings of such interventions.

Details

International Journal of Sustainability in Higher Education, vol. 19 no. 7
Type: Research Article
ISSN: 1467-6370

Keywords

Open Access
Article
Publication date: 3 July 2017

Leony Derick, Gayane Sedrakyan, Pedro J. Munoz-Merino, Carlos Delgado Kloos and Katrien Verbert

The purpose of this paper is to evaluate four visualizations that represent affective states of students.

2070

Abstract

Purpose

The purpose of this paper is to evaluate four visualizations that represent affective states of students.

Design/methodology/approach

An empirical-experimental study approach was used to assess the usability of affective state visualizations in a learning context. The first study was conducted with students who had knowledge of visualization techniques (n=10). The insights from this pilot study were used to improve the interpretability and ease of use of the visualizations. The second study was conducted with the improved visualizations with students who had no or limited knowledge of visualization techniques (n=105).

Findings

The results indicate that usability, measured by perceived usefulness and insight, is overall acceptable. However, the findings also suggest that interpretability of some visualizations, in terms of the capability to support emotional awareness, still needs to be improved. The level of students’ awareness of their emotions during learning activities based on the visualization interpretation varied depending on previous knowledge of information visualization techniques. Awareness was found to be high for the most frequently experienced emotions and activities that were the most frustrating, but lower for more complex insights such as interpreting differences with peers. Furthermore, simpler visualizations resulted in better outcomes than more complex techniques.

Originality/value

Detection of affective states of students and visualizations of these states in computer-based learning environments have been proposed to support student awareness and improve learning. However, the evaluation of visualizations of these affective states with students to support awareness in real life settings is an open issue.

Details

Journal of Research in Innovative Teaching & Learning, vol. 10 no. 2
Type: Research Article
ISSN: 2397-7604

Keywords

Open Access
Article
Publication date: 13 November 2018

Matthias Kuhnel, Luisa Seiler, Andrea Honal and Dirk Ifenthaler

The purpose of the study was to test the usability of the MyLA app prototype by its potential users. Furthermore, the Web app will be introduced in the framework of “Mobile…

7613

Abstract

Purpose

The purpose of the study was to test the usability of the MyLA app prototype by its potential users. Furthermore, the Web app will be introduced in the framework of “Mobile Learning Analytics”, a cooperation project between the Cooperative State University Mannheim and University of Mannheim. The participating universities focus on the support of personalized and self-regulated learning. MyLA collects data such as learning behavior, as well as personality traits. Last but not least, the paper will contribute to the topic of learning analytics and mobile learning in higher education.

Design/methodology

For the empirical investigation, a mixed-method design was chosen. While 105 participants took part in the conducted online survey, after testing the app prototype, seven students joined an additional eye tracking study. For the quantitative part, a selected question pool from HIMATT (highly integrated model assessment technology and tools) instrument was chosen. The eye tracking investigation consisted of three tasks the participants had to solve.

Findings

The findings showed that the students assessed the idea of the app, as well as the navigation positively. Only the color scheme of the prototype was not very attractive to a noticeable amount of the participants. So, it requires slight modifications concerning the app design. For the eye tracking study, it can be stated that the students viewed the relevant parts, and they basically had no difficulties to solve the tasks.

Originality/value

Due to the empirical testing of the app prototype, the project team was able to adjust the application and to add further features. Furthermore, the backend was programmed and an additional tool (MyLA dashboard) was developed for lecturers. A mutual understanding of the targets, privacy issue and relevant features are indispensable for further development of the project.

Details

Interactive Technology and Smart Education, vol. 15 no. 4
Type: Research Article
ISSN: 1741-5659

Keywords

Open Access
Article
Publication date: 14 September 2020

Siddarth Nair, Abhishek Kaushik and Harnaik Dhoot

Skills form an integral part of an organization for its efficient functioning. This research study investigates mechanisms to actively persuade employees and organizations to…

4667

Abstract

Skills form an integral part of an organization for its efficient functioning. This research study investigates mechanisms to actively persuade employees and organizations to change their attitudes and perspectives towards skills through the design and implementation of a skill-based system. The aim of the project is to know if we can create a skill-focused climate in a software organization through a software system proposed by the researcher and if such a system will help in utilizing in-house employees for new opportunities rather than hiring new employees. Feedback was collected on the proposed skill-based system from software professionals and human resource managers through an online survey. Findings reveal that the proposed skill-based system will create a skill-focused climate in a software organization and also help in better utilization of internal employees for new skill requirements rather than directly hiring external employees.

Details

Applied Computing and Informatics, vol. 19 no. 1/2
Type: Research Article
ISSN: 2634-1964

Keywords

Open Access
Article
Publication date: 3 June 2021

Vincenzo Corvello, Monica De Carolis, Saverino Verteramo and Annika Steiber

This paper explores digital transformation's impact on the work of owners in entrepreneurial firms. The interplay between working practices and technology is analyzed, taking into…

7464

Abstract

Purpose

This paper explores digital transformation's impact on the work of owners in entrepreneurial firms. The interplay between working practices and technology is analyzed, taking into account the organizations' specific contexts.

Design/methodology/approach

A multiple case study design was applied. Eight cases of entrepreneurial firms, defined as companies that bring new products and services to the market by creating and seizing opportunities, were selected, with the goal to maximize the diversity of cases. The sample includes both small- and medium-sized firms, as well as high- tech and low- tech companies in equal number. Interviews have been used to collect both quantitative and qualitative data, which was analyzed in a structured way.

Findings

The digital transformation of entrepreneurial work, that is the daily work of entrepreneurs, is an evolutionary, practice-based phenomenon, rather than the result of rational design. The use of different digital tools is interrelated and depends on the characteristics, and dynamics of the surrounding environment.

Practical implications

The findings of this study are relevant to entrepreneurs interested in understanding the dynamics of their working practice, to software development firms interested in entrepreneurs as customers and to institutions interested in the education of entrepreneurs.

Originality/value

To the best of the authors' knowledge this is the first study which considers the interplay between digital technology and the daily activities of entrepreneurs, considered as a whole. It provides insights on how these interconnected dimensions evolve, thus contributing to understanding the work of entrepreneurs, and as a consequence the dynamics of entrepreneurial firms in the context of digital transformation of organizations.

Details

International Journal of Entrepreneurial Behavior & Research, vol. 28 no. 5
Type: Research Article
ISSN: 1355-2554

Keywords

1 – 10 of 318