Search results

The purpose of this paper is to validate and measure the overall evaluation of electronic health record (EHR) and identify the factors that influence the health information systems (HIS) assessment in Brazil.

From February to May 2020, this study surveyed 262 doctors and nurses who work in hospitals and use the EHR in their workplace. This study validated the National Usability-focused HIS Scale (NuHISS) to measure usability in the Brazilian context.

The results showed adequate validity and reliability, validating the NuHISS in the Brazilian context. The survey showed that 38.9% of users rated the system as high quality. Technical quality, ease of use and benefits explained 43.5% of the user’s overall system evaluation.

This study validated the items that measure usability of health-care systems and identified that not all usability items impact the overall evaluation of the EHR.

NuHISS can be a valuable tool to measure HIS usability for doctors and nurses and monitor health systems’ long-term usability among health professionals. The results suggest dissatisfaction with the usability of HIS systems, specifically the EHR in hospital units. For this reason, those responsible for health systems must observe usability. This tool enables usability monitoring to highlight information system deficiencies for public managers. Furthermore, the government can create and develop actions to improve the existing tools to support health professionals.

From the scale validation, public managers could monitor and develop actions to foster the system’s usability, especially the system’s technical qualities – the factor that impacted the overall system evaluation.

To the best of the authors’ knowledge, this study is the first to validate the usability scale of EHR systems in Brazil. The results showed dissatisfaction with HIS and identified the factors that most influence the system evaluation.

This chapter describes how researchers and developers may improve the design of technical innovations for crisis communicators by testing how user-friendly the innovation is for its intended end users. In the RESCUE project, a tool for social media information gathering was developed. During this process, tool usability was thoroughly tested. Good usability allows the user to complete tasks and achieve goals with effectiveness, efficiency and satisfaction. The purpose of the usability testing was to strive for a tool that is easy to use during demanding circumstances and contributes to a high level of situation awareness (SA) among users. SA is about being aware of what is happening around you – during, for example, emergency assignments – and what this means for your on-going work tasks. The main focus of this chapter is to describe how usability testing was applied throughout the tool development process, from the pre-production planning phase to the final phase. As a part of this, the tool features are described.

Technical solutions can be important when key communicators take on the task of making sense of social media flows during crises. However, to provide situation awareness during high-stress assignments, usability problems must be identified and corrected. In usability studies, where researchers investigate the user-friendliness of a product, several types of data gathering methods can be combined. Methods may include subjective (surveys and observations) and psychophysiological (e.g. skin conductance and eye tracking) data collection. This chapter mainly focuses on how the latter type can provide detailed clues about user-friendliness. Results from two studies are summarised. The tool tested is intended to help communicators and journalists with monitoring and handling social media content during times of crises.

The purpose of this study is to describe the implementation of a digital-based team coaching intervention aimed at improving team communication in the workplace through social network visualization. The study examined recipients’ perceptions of the intervention at two time points and assessed the temporal stability of various factors, including the intervention’s integrity, design, transferability, acceptance and the usability of the adopted visualization tool. The moderating role of digital usability was also evaluated.

Four team coaching sessions were delivered to 62 participants from seven teams across three departments within a large public health-care organization in Northern Italy. Perceptions of the intervention dimensions were collected after the second and fourth sessions.

Results indicated that, at both time points, recipients appreciated the intervention’s integrity and usability more than its design, transferability and acceptance. Furthermore, no significant changes in recipients’ perceptions were observed over time. The transferability of the intervention was significantly associated with its acceptance, but only when the usability of the digital tool was high.

The study enriches existing literature on digital interventions in group communication by focusing on process dimensions like recipients’ perceptions of various aspects and the implementation process. Furthermore, the study underscores the potential of integrating specific techniques such as sociomapping and coaching within health-care organizations, encouraging more research and development in these areas.

The study emphasizes the critical role of usability and integrity in digital-based team coaching interventions, suggesting that high-quality, user-friendly tools not only lead to initial effectiveness but also sustain positive impacts over time, while also increasing transferability and acceptance.

The present study uniquely deploys a longitudinal approach to examine recipients’ perceptions of a digital-based intervention that combines social network visualization and team coaching to enhance team communication.

This study aims to evaluate the usability of the augmented reality-based Evoke Education System (EES) to improve service operations in educational settings. The EES uses an animated character (Moe) to interact with children in a classroom by reproducing their teacher's movements and speech.

This study uses a quantitative approach for the system usability evaluation. The ESS was evaluated by 71 children aged 6–8 years old, from two primary schools. After interacting with the EES, they completed a system usability questionnaire and participated in a knowledge acquisition test.

The knowledge acquisition test undertaken on the initial day showed statistically significant improvements for children taught with the EES, compared to children taught through traditional teaching approaches. However, the retest nine days later was not statistically significant (as only one school participated) due to low power. This study used confirmatory factor analysis (CFA), resulting in the identification of five essential factors (likeability, interactiveness, retention, effectiveness/attractiveness and satisfaction) that contribute to the EES's usability. The comparison with existing literature shows that these factors are consistent with the definition of system usability provided by the International Organization for Standardization and current academic literature in this field.

The findings presented in this study are based on the data from only two schools. The research can be extended by involving children from a greater number of schools. Mixed methods and qualitative research approaches can be used for future research in this area to generalise the results.

This study proposes an innovative augmented reality-based education system to help teachers deliver their key messages to the children in a fun way that can potentially increase their knowledge retention.

Designing effective business analytics (BA) platforms that visualise data, provide deep insights and support data-driven decision-making is a challenging task. Understanding the elements shaping BA platform design is crucial for success. The purpose of this study is to explore the impact of visualisation on usability (UI) and user experience (UX) while emphasising the importance of insights understanding in BA platform design.

This paper presents a case study following a startup’s journey as it undergoes two redesign phases for its BA platform. A combination of quantitative and qualitative methods is used to assess UX/UI and insights understanding of the platform. Indicatively this included semi-structured interviews, observations, think-aloud techniques and surveys to monitor runtime per task, number of errors, users’ emotions and users’ understanding.

Our findings suggest that modifications in aesthetics and information visualisation positively influence overall usability, UX, and understanding of platform insights – a critical aspect for the success of the startup.

Our goal is not to make a methodological contribution, but to illustrate how companies, constrained by time and pressure, navigate platform changes without meticulous design and provide learnings on important elements while designing BA platforms.

This paper concludes with suggested methods for assessing BA platforms and recommends practical practices to follow. These practices include recommendations on important elements for BA platform users, such as navigation and interactivity, user control and personalisation, visual consistency and effective visualisation.

This study contributes to practice as it presents a real-life case and offers valuable insights for practitioners.

Despite the technological paradigm shift presented to the architecture, engineering, construction and operations sector (AECO), the full-fledged acceptance of the building information modelling (BIM) methodology has been slower than initially anticipated. Indeed, this study aims to acknowledge the need for increasing supportive technologies enabling the use of BIM, attending to available human resources, their requirements and their tasks.

A complete case study is described, including the development process centred on design science research methodology followed by the usability assessment procedure validated by construction projects facility management operational staff.

Results show that participants could interact with BIM using openBIM processes and file formats naturally, as most participants reached an efficiency level close to that expected for users already familiar with the interface (i.e. high-efficiency values). These results are consistent with the reported perceived satisfaction and analysis of participants’ discourses through 62 semi-structured interviews.

The contributions of the present study are twofold: a proposal for a virtual reality openBIM framework is presented, particularly for the semantic enrichment of BIM models, and a methodology for evaluating the usability of this type of system in the AECO sector.

This research work aims to arise from developing new communication channels for customer service in micro, small and medium enterprises (MSMEs), such as chatbots. In particular, the results of the usability testing of three chatbots implemented in MSMEs are presented.

The methodology employed includes participants, chatbot development platform, research methodology, software development methodology and usability test to contextualize the study's results.

Based on the results obtained from the System Usability Scale (SUS) and considering the accuracy of the chatbot's responses, it is concluded that the level of satisfaction in using chatbots is high; therefore, if the chatbot is well integrated with the communication systems/channels of the MSMEs, the client receives an excellent, fast and efficient service.

The paper analyzes chatbots for customer service and presents the usability testing results of three chatbots implemented in MSMEs.

The purpose of this paper is to present mobile solutions that aid in accessing open educational resources (OERs) in areas that have limited bandwidth resulting in poor internet connectivity and a gap between those with ready access to the online OERs and those without such access.

A system architecture was designed to support the repository-based, mobile-friendly, and hybrid online/offline characteristics of OERs. In a hybrid online/offline setup, the learner connects to the internet to obtain OERs from the repository via a process called syncing. Afterward, he may view any OER content regardless of whether he is online or offline. Mobile solutions based on Browser-Like Android App (BLAP)/HTTrack and Worona/Corona approaches were successfully implemented and evaluated by 139 respondents using the System Usability Scale.

BLAP/HTTrack and Worona/Corona solutions were well received. These were found to be both relatively usable, acquiring above-average usability scores of 73.2374 and 71.6546, respectively.

The findings of this study aim to contribute to the literature of hybrid online/offline model that addresses low bandwidth access of OERs in developing countries, which is not historically well provided.

The mobile solutions were designed to help those learners who experience internet connectivity difficulties in accessing OERs efficiently and updating them conveniently.