Search results

The field of website quality evaluation attracts the interest of a range of disciplines, each bringing its own particular perspective to bear. This study aims to identify the main characteristics – methods, techniques and tools – of the instruments of evaluation described in this literature, with a specific concern for the factors analysed, and based on these, a multipurpose model is proposed for the development of new comprehensive instruments.

Following a systematic bibliographic review, 305 publications on website quality are examined, the field's leading authors, their disciplines of origin and the sectors to which the websites being assessed belong are identified, and the methods they employ characterised.

Evaluations of website quality tend to be conducted with one of three primary focuses: strategic, functional or experiential. The technique of expert analysis predominates over user studies and most of the instruments examined classify the characteristics to be evaluated – for example, usability and content – into factors that operate at different levels, albeit that there is little agreement on the names used in referring to them.

Based on the factors detected in the 50 most cited works, a model is developed that classifies these factors into 13 dimensions and more than 120 general parameters. The resulting model provides a comprehensive evaluation framework and constitutes an initial step towards a shared conceptualization of the discipline of website quality.

Mobile learning has seen tremendous growth over the years. Like any other software application, usability is one of the key concerns in its successful implementation. There is a lack of study that provides a comprehensive overview of usability testing of mobile learning applications. Motivated by this a mapping study is conducted.

A systematic mapping study was conducted using 51 papers retrieved from the Scopus database published between 2005 and 2022 that reported on usability testing of mobile learning applications.

The key findings suggest that research is expected to expand in the near future. User-based testing is the commonly used method, while data are collected mainly through questionnaires, observation and interviews. Testing is mainly conducted in a controlled environment.

The study provides (1) an evidence-based discussion on usability testing of mobile learning applications, (2) an up-to-date map on state of the art on usability testing of mobile learning applications and (3) providing direction for further research to scientifically strengthen the field.

This paper aims to evaluate the Digital Government Collaborative Platform (DGCP), which facilitates collaborations between the citizens and the government to address environmental issues in Sri Lanka. The DGCP is an artifact developed by the value-sensitive design approach.

The DGCP is evaluated following the Framework for Evaluation in Design Science Research (FEDS). In total, 224 citizens participated in the survey based on the User Experience Questionnaire (UEQ) and open questions about human values embedded in the design. Fifteen government officers were interviewed to enhance the evaluation.

The DGCP received positive evaluations from the citizens and government officers. The platform is attractive, novel and pragmatic, also generating hedonic experiences for the citizens. The users believed that human values are reflected in the DGCP. Furthermore, they shared a few suggestions to improve it.

The paper contributes knowledge to evaluating digital government systems, especially in developing countries. The human-value-centered DGCP was evaluated using multiple methods of quantitative (i.e. UEQ Survey) and qualitative (i.e. qualitative interviews with stakeholders) techniques. Furthermore, the systematic process of DGCP evaluation produces a case-based guideline for evaluating related and similar digital government systems using FEDS.

The study aims to determine whether audited organizations experience differences between external audits and official controls.

A survey among 100 organic food producers was conducted to explore differences regarding the usability of external audits and official controls. The survey was conducted in 2020 using the computer-assisted telephone interview (CATI) method supplemented by the computer-assisted web interview (CAWI) method. Organizations processing organic farming products in Poland were chosen for the study.

Three primary benefits associated with external audits and official controls were identified, i.e. (1) enabling and initiating activities related to the improvement of the organization, (2) improving the financial performance of the organization and (3) enhancing credibility. For most organizations, the assessment of these features was at the same level for both external audits and official control. However, if these assessments differed, commercial audits were assessed at a higher level than official controls.

The study is limited to only one specific type of manufacturing organization and one European country.

The literature review shows some conceptual differences between audits and official controls, but the results of this study show that the business environment does not perceive these differences as significant. Thus, the value of the study is reflected in the conclusion that both external audits and official controls are considered useful and credible approaches to monitoring the quality within the organization, which allows us to state that external evaluation is generally seen as an opportunity to improve the performance of the organization.

Develop a comprehensive framework for assessing the knowledge organization systems (KOSs), including the taxonomy of Wikipedia and the ontologies of Wikidata, with a specific focus on enhancing management and retrieval with a gender nonbinary perspective.

This study employs heuristic and inspection methods to assess Wikipedia’s KOS, ensuring compliance with international standards. It evaluates the efficiency of retrieving non-masculine gender-related articles using the Catalan Wikipedian category scheme, identifying limitations. Additionally, a novel assessment of Wikidata ontologies examines their structure and coverage of gender-related properties, comparing them to Wikipedia’s taxonomy for advantages and enhancements.

This study evaluates Wikipedia’s taxonomy and Wikidata’s ontologies, establishing evaluation criteria for gender-based categorization and exploring their structural effectiveness. The evaluation process suggests that Wikidata ontologies may offer a viable solution to address Wikipedia’s categorization challenges.

The assessment of Wikipedia categories (taxonomy) based on KOS standards leads to the conclusion that there is ample room for improvement, not only in matters concerning gender identity but also in the overall KOS to enhance search and retrieval for users. These findings bear relevance for the design of tools to support information retrieval on knowledge-rich websites, as they assist users in exploring topics and concepts.

Tracking physical resources at the construction site can generate information to support effective decision-making and building production control. However, the methods for conventional tracking usually offer low reliability. This study aims to propose the integrated Smart Twins 4.0 to track and manage metallic formworks used in cast-in-place concrete wall systems using internet of things (IoT) (operationalized by radio frequency identification [RFID]) and building information modeling (BIM), focusing on increasing quality and productivity.

Design science research is the research approach, including an exploratory study to map the constructive system, the integrated system development, an on-site pilot implementation in a residential project and a performance evaluation based on acquired data and the perception of the project’s production team.

In all rounds of requests, Smart Twins 4.0 registered and presented the status from the formworks and the work progress of buildings in complete correspondence with the physical progress providing information to support decision-making during operation. Moreover, analyses of the system infrastructure and implementation details can drive researchers regarding future IoT and BIM implementation in real construction sites.

The primary contribution is the system proposal, centralized into a mobile app that contains a Web-based virtual model to receive data in real time during construction phases and solve a real problem. The paper describes Smart Twins 4.0 development and its requirements for tracking physical resources considering theoretical and practical previous research regarding RFID, IoT and BIM.

The compliance checking of Building Information Modeling (BIM) models is crucial throughout the lifecycle of construction. The increasing amount and complexity of information carried by BIM models have made compliance checking more challenging, and manual methods are prone to errors. Therefore, this study aims to propose an integrative conceptual framework for automated compliance checking of BIM models, allowing for the identification of errors within BIM models.

This study first analyzed the typical building standards in the field of architecture and fire protection, and then the ontology of these elements is developed. Based on this, a building standard corpus is built, and deep learning models are trained to automatically label the building standard texts. The Neo4j is utilized for knowledge graph construction and storage, and a data extraction method based on the Dynamo is designed to obtain checking data files. After that, a matching algorithm is devised to express the logical rules of knowledge graph triples, resulting in automated compliance checking for BIM models.

Case validation results showed that this theoretical framework can achieve the automatic construction of domain knowledge graphs and automatic checking of BIM model compliance. Compared with traditional methods, this method has a higher degree of automation and portability.

This study introduces knowledge graphs and natural language processing technology into the field of BIM model checking and completes the automated process of constructing domain knowledge graphs and checking BIM model data. The validation of its functionality and usability through two case studies on a self-developed BIM checking platform.

The objective of this research is to propose an immersive framework that integrates virtual reality (VR) technology with directives international safety training certification bodies to enhance construction safety training, which eventually leads to safer construction sites.

The adopted methodology combines expert insights and experimentation to maximize the effectiveness of construction safety training. The first step was identifying key considerations for VR models such as motion sickness prevention and adult learning theories. The second step was developing a game-like VR model for safety training, with multiple hazards and scenarios based on the considerations of the previous step. After that, safety experts evaluated the model and provided valuable feedback on its alignment with international safety training practices. Finally, the developed model is tested by senior students, where the testing format followed the Institution of Occupational Safety and Health (IOSH) working safely exam structure.

An advanced immersive VR safety training model was developed based on extensive lessons learned from the literature, previous work and psychology-informed adult learning theories. Model testing – through focus groups and hands-on experimentation – demonstrated significant benefit of VR in upgrading and complementing traditional training methods.

The findings presented in this paper make a significant contribution to the field of safety training within the construction industry and the broader context of immersive learning experiences. It also fosters further exploration into immersive learning experiences across educational and professional contexts.

The purpose of this study is to describe the design and validation of a three-dimensional (3D)-printed phantom of a uterus to support the development of uterine balloon tamponade devices conceived to stop post-partum haemorrhages (PPHs).

The phantom 3D model is generated by analysing the main requirements for validating uterine balloon tamponade devices. A modular approach is implemented to guarantee that the phantom allows testing these devices under multiple working conditions. Once finalised the design, the phantom effectiveness is validated experimentally.

The modular phantom allows performing the required measurements for testing the performance of devices designed to stop PPH.

PPH is the leading obstetric cause of maternal death worldwide, mainly in low- and middle-income countries. The proposed phantom could speed up and optimise the design and validation of devices for PPH treatment, reducing the maternal mortality ratio.

To the best of the authors’ knowledge, the 3D-printed phantom represents the first example of a modular, flexible and transparent uterus model. It can be used to validate and perform usability tests of medical devices.