Search results

Databases on CDROM are one of the more complex types of facility that will be accessed by the general public, either in their home, in airport lounges and other public arenas or in libraries. These databases extend over a wide range of different media types including bibliographic, full‐text and multimedia. Interfaces include DOS‐based and GUI‐based products. This paper reviews the literature on the design and evaluation of user interfaces on CDROM, with the objective of distilling guidelines for these activities. More specifically the article defines interfaces, dialogues and interaction, and explores the diversity in and issues associated with standardisation in interface design for CDROMs. Current criteria and guidelines for the evaluation of CDROM interfaces include those of the Special Interest Group on CDROM Applications and Technology (SIGCAT) and guidelines proposed by other authors. Using this earlier work as a basis an alternative set of guidelines is proposed.

A growing literature reports the benefits and challenges of patient and public involvement (PPI) in research; nevertheless, understanding PPI in research design remains under-developed. The purpose of this paper is to report learning experiences from involving service users as research partners in two projects that developed and evaluated guidelines for good practice in this regard. The main objective was to evaluate these guidelines.

PPI research guidelines were developed through five workshops involving service users/patients, carers, health and social care professionals/managers and academics. Using a participatory qualitative approach, these guidelines were evaluated through mapping them against the two service user research partners’ experience within another project.

The guidelines were found to be fit for purpose, as they allowed problems to be easily identified and reassurance that required standards were being met. Both academic and service user research partners learned and gained relevant skills. Two service user research partners also found their daily living skills unexpectedly enhanced by project participation.

The PPI guidelines, the authors developed were produced by consensus involving several stakeholders. Service users involved as research partners in the project experienced unanticipated personal benefits.

Existing guidelines are typically extracted from a few empirical evaluations of pervasive game prototypes featuring incompatible scenarios, game play design and technical characteristics. Hence, the applicability of those design guidelines across the increasingly diverse landscape of pervasive games is questionable and should be investigated.

This paper presents Barbarossa, a scenario-driven pervasive game that encompasses different game modes, purposely adopting opposing principles in addressing the core elements of challenge and control. Using Barbarossa as a testbed, this study aims at validating the applicability of existing design guidelines across diverse game design approaches.

The compilation of Barbarossa user evaluation results confirmed the limited applicability of existing guidelines and provided evidence that developers should handle core game elements, taking into account the game play characteristics derived from their scenario.

Stepping upon those findings, the authors propose a revision of design guidelines relevant to control and challenge based on elaborate classification criteria for pervasive game prototypes.

This paper describes the implementation of a clinical guideline across three acute Trusts. A Clinical Effectiveness Steering Group identified prevention of venous thromboembolism as a health priority. A local guideline development group adapted the recommendations of an existing review and produced a local guideline. Then, a multidisciplinary implementation group developed the practical aspects of implementing guidelines into routine daily practice. They identified appropriate staff to carry out risk assessment and to administer appropriate prophylaxis, as necessary. They also produced a “guideline pack” containing a training resource manual and implementation aids. Following this a multiple strategy implementation programme was used to introduce the guidelines, and an evaluation was carried out eight to ten months after the introduction of the guidelines. The evaluation identified a number of areas for improving current practice. Guideline implementation is a complex, time‐consuming process.

This paper describes the implementation of a clinical guideline across three acute Trusts. A Clinical Effectiveness Steering Group identified prevention of venous thromboembolism as a health priority. A local guideline development group adapted the recommendations of an existing review and produced a local guideline. Then, a multidisciplinary implementation group developed the practical aspects of implementing guidelines into routine daily practice. They identified appropriate staff to carry out risk assessment and to administer appropriate prophylaxis, as necessary. They also produced a “guideline pack” containing a training resource manual and implementation aids. Following this a multiple strategy implementation programme was used to introduce the guidelines, and an evaluation was carried out eight to ten months after the introduction of the guidelines. The evaluation identified a number of areas for improving current practice. Guideline implementation is a complex, time‐consuming process.

This study aims to investigate the perceptional differences of key stakeholders in assessing the Digital Library Accessibility and Usability Guidelines (DLAUG), in which design information is created and organized by types of help-seeking situations, to support blind and visually impaired (BVI) users. The stakeholders consist of BVI users, digital library (DL) developers and scholars/experts. The focus is on the identification of types of situations in which BVI users and developers show significant perception differences of DLAUG’s relevance, clarity and usefulness than the other two groups, respectively, and the associated reasons.

An in-depth survey was conducted to examine the perceptions of 150 participants representing three groups of key DL stakeholders: BVI users, DL developers and scholars/experts. Both qualitative and quantitative analyses were applied.

The results show that BVI users and developers had significant perception differences of the relevance, clarity and usefulness of the DLAUG than the other two groups held on five situations, mainly because they played distinct roles in the development of DLs with differing goals and expectations for the DL design guidelines.

This is the first study that considers different DL stakeholders to assess DL guidelines to support BVI users.

This article explores the applicability of participatory action research (PAR) on two levels: on the one hand, as a participatory evaluation method for community engagement and community development; on the other hand, as a tool to link ex ante and ex-post evaluation that situated at various stages of the policy cycle.

Through a practice-based case study of the community engagement process of Valletta Design Cluster, this paper aims to illustrate how PAR can offer collaborative and continuous evaluation by facilitating social action through a practical, situative, context-bounded, responsive and transformative framework.

The study explores how PAR can contribute to cultural sustainability by linking community development with participatory evaluation, and it offers new perspectives on the applicability of PAR as a tool to link ex ante and ex-post evaluation, situated at various stages of the policy cycle.

Although based on a single case, the paper demonstrates that the method has the potential to be applied in various contexts, as it helps to foster local ownership and to develop future cultural strategies, thus providing a base for cultural sustainability.

The novelty of this study is to link evaluation – a majorly top-down and ex ante approach – with participatory planning. PAR-E offers a continuous participatory framework for the whole European Capitals of Culture (ECoC) cycle, as well as serving as a tool for empowerment and community development.

The purpose of this paper is to present a methodology that may be used to perform evaluation of business process management (BPM) methodologies. As this area lacks proper formalized approaches, the aim of the publication is to promote the new approach, proposed by the authors.

The authors analyse related methodologies and theoretical background. Based on that, they suggest an evaluation approach, which is used to verify correctness of a semantic BPM (SBPM) methodology.

The proposed evaluation methodology has been practically tested. Additional interviews have been conducted and interviewees stress high value of the approach. The presented evaluation methodology was validated on the example of the SBPM methodology used in a European integrated project.

The results of this paper can be used to guide development and verify correctness of new BPM methodologies.

The paper demonstrates how validation of BPM methodologies can be conducted in practice.

The approach presented in the paper is the first comprehensive approach to provide methodology for evaluating BPM methodologies.

International development and humanitarian work, including research and evaluation practice, relies upon the development of strong and trusting relationships between practitioners, researchers, local partners and communities. Due to these relationships, research conducted in developing countries and particularly in relation to development practice raises distinct ethical issues and dilemmas. The aim of this chapter is to discuss the importance of the consideration of ethics in international development and humanitarian research and how organisations can incorporate a culture of ethical inquiry into research and evaluation practice. It will highlight that good intentions and policy documents are alone not enough for when practitioners are working in development. It will also examine how principles and guidelines drafted expressly for and by the Australian international development sector is being used as a facilitator of ethical inquiry and good practice.

The purpose of this paper is to demonstrate the importance of undertaking a systemic view of information systems evaluation that augments the frequently reported prescriptive (cost/benefit) analysis approaches.

The paper adopts a qualitative case perspective and derives a framework for substantive information systems evaluation factors (PRISE). Three empirical formulations are considered and a comparison made to determine the content and context of the findings.

The findings support the flexibility and relevance of PRISE as a framework for information systems evaluation. It notes the objectives, relations and components for explicitly identifying the outputs required to make a valid assessment of the systems.

The study is limited contextually where attention should be made not to generalise the findings beyond the empirical findings within the case analysis. Further studies may usefully include the main features of PRISE but taking into account their unique research environment.

The study supports a practitioner perspective through a consideration of a holistic approach to information systems evaluation. Managers may implement the notion of including people, resources and benefits in their attempts to determine the added value of these systems to the organisation that extends beyond a simple financial calculation.

The paper is highly original as the framework has been derived through both theoretical constructs and empirical analysis. It provides an innovative approach to information system evaluation that is intellectually sound and practically orientated.