Search results

An alarming number of spreadsheet faults have been reported in the literature, indicating that effective and easy-to-apply spreadsheet testing techniques are not available for “non-technical,” end-user programmers. The purpose of this paper is to alleviate the problem by introducing a metamorphic testing (MT) technique for spreadsheets.

The paper discussed four common challenges encountered by end-user programmers when testing a spreadsheet. The MT technique was then discussed and how it could be used to solve the common challenges was explained. An experiment involving several “real-world” spreadsheets was performed to determine the viability and effectiveness of MT.

The experiment confirmed that MT is highly effective in spreadsheet fault detection, and yet MT is a general technique that can be easily used by end-user programmers to test a large variety of spreadsheet applications.

The paper provides a detailed discussion of some common challenges of spreadsheet testing encountered by end-user programmers. To the best of the authors knowledge, the paper is the first that includes an empirical study of how effective MT is in spreadsheet fault detection from an end-user programmer's perspective.

The purpose of this paper is to investigate usability testing methods currently in use outside of library science, primarily in the business world, and to find important techniques that can be applied to library science to improve usability testing in libraries.

Objectives are achieved through a review of the business literature on qualitative and quantitative web site usability testing. The approach to the topic is based on an assumption that businesses are constantly refining their testing methods in order to make a profit; therefore, their testing methods are evolving and may ultimately be more efficient and effective than the techniques currently in use in libraries. Because businesses are dependent on consumer choice, they must provide user‐friendly web interfaces developed out of usability testing.

The findings of this paper illustrate that there are many useful kernels of information about testing that can be gleaned from the business literature and applied to testing in a library environment. Testing methods not in use in libraries that are covered include: process‐oriented testing, side‐by‐side testing, hybrid testing, and unique qualitative data gathering methods.

There are many testing methods discussed in this paper that can be implemented in libraries. The paper suggests how these methods can be adapted to fit a library testing setting and improve the current testing process in place in most libraries. Improved testing methods will ultimately result in improved web site interfaces, which will increase user access to information and help libraries fulfill their missions to make information and online resources accessible to all.

Usability testing methods currently not in use in libraries are proposed. The methods discussed can help librarians change and improve their testing methodologies in order to help libraries compete in the increasingly crowded information marketplace.

The purpose of this paper is to develop a methodological usability evaluation approach for e‐commerce websites in developing countries.

A multi‐faceted usability evaluation of three Jordanian e‐commerce websites was used, where three usability methods (user testing, heuristic evaluation and web analytics) were applied to the sites.

A four‐step approach was developed to facilitate the evaluation of e‐commerce sites, mindful of the advantages and disadvantages of the methods used in identifying specific usability problems.

The approach was developed and tested using Jordanian users, experts and e‐commerce sites. The study compared the ability of the methods to detect problems that were present, however, usability issues not present on any of the sites could not be considered when creating the approach.

The approach helps e‐commerce retailers evaluate the usability of their websites and understand which usability method(s) best matches their need.

This research proposes a new approach for evaluating the usability of e‐commerce sites. A novel aspect is the use of web analytics (Google Analytics software) as a component in the usability evaluation in conjunction with heuristics and user testing.

The purpose of this paper is to describes the methods and findings of two research projects undertaken to explore user behaviour and usability issues relating to the use of Web‐based resources by people with disabilities.

Whilst the aims of the research differed, the methods adopted were similar – including observation, talk aloud protocols, questionnaires and focus groups.

The findings from both studies provided evidence of the problems faced by disabled users when using Web‐based resources. It provided evidence of the types of features users liked and disliked, how they overcame navigational problems and what types of features enhanced their experience, all of which can be fed back into recommendations for the design of electronic resources.

The richness of the data collected for both studies confirmed the importance of involving users in accessibility and usability assessments. Analysis of both the findings and the methods for both studies also enabled a checklist to be developed, outlining issues that should be taken into consideration when planning a usability test.

Document analysis of past and current usability studies revealed that suggested methods are often directed more towards expert usability testing, rather than managing the user testing in‐house. Although it may be preferable to engage an expert, in reality practical guidance is also needed. The checklist aims to address gaps in usability advice identified, by providing practical guidance to enable providers and developers of web‐based resources to conduct their own effective usability testing.

The purpose of this paper is to describe a case study of the development, features and evaluation of a rich internet application for libraries. It aims to demonstrate best practice in the use of software standards, development processes and evaluation.

Web 2.0, open source design methods and usability testing were used within an agile framework.

The adoption of agile software development methods, coupled with usability testing, would enable the library community to take full advantage of the techniques and principles inherent in Web 2.0 open source software.

A major component of the evaluation of OJAX was a series of usability tests. As is the nature of most usability studies, the results are not generalisable.

Aspects of agile software development methods, such as usability testing and iterative design, are recognised in the literature as contributing to the usability of library software. However, exploration of the use of a full agile framework plus usability testing to facilitate Web 2.0 open source software is rare in library‐related literature.

The aim of this paper is to discuss the application of a web‐based tool as a remote asynchronous usability testing method based on an assessment of an academic library's digital collections website.

The paper examines the selection of an asynchronous remote usability testing method, the reasons for the selection of SurveyMonkey, an evaluation of its effectiveness through an assessment of the digital collections web site, and the potential for its application in future usability studies.

SurveyMonkey can be employed as an assessment tool with advance planning by evaluators to capture the responses and opinions of users. Overall, it is a cost effective and time‐saving option for small assessment projects.

This was an informal study where a specific product, SurveyMonkey, was tested with the purpose of evaluating its effectiveness as a remote asynchronous assessment tool through its application for a specific website usability study. The assessment was not compared to other testing methods, and the tool was not evaluated through formal methods.

Libraries and other organizations can look to free, or low‐cost, web‐based tools as an alternative to more traditional methods, such as focus groups, when evaluating services.

The paper describes the creation and implementation of a web‐based usability test for a library website using a specific product. It looks at the effectiveness of the assessment tool based on cost and time requirements, in addition to the benefits and disadvantages of conducting remote usability testing.

Usability testing of Web interfaces for virtual libraries is a crucial factor in the continuing development and improvement of the user interface. In 1999, the University of South Florida Libraries decided to embark on a usability study to coincide with the rollout of a new interface design. Because this type of study had not been conducted with the initial interface, its implementation and completion were paramount in the development of the new design. Details the preliminary activities, testing methodologies and results of usability testing by the USF virtual library project’s usability study group.

The purpose of this paper is to describe the development and evaluation of a geographical information system (GIS) testing framework that was used to test a fire prevention support GIS.

A year‐long case study was undertaken concerning the testing of a fire prevention support GIS in a UK fire and rescue service.

The GIS testing framework developed involved testing the different components of a GIS, testing their interactions, and then testing the system as a whole. Since GISs contain different components such as spatial analyses and map‐based output, this supports the adoption of a different testing framework compared to existing types of information systems.

GISs will typically be used by organisations for decision making. Clearly if the information presented by a GIS is inaccurate, unrepresentative, or unreliable, then the decision‐making process can be undermined.

This is particularly important with regard to GISs used by emergency services (such as the fire and rescue service studied) where lives could potentially be put at risk by erroneous information provided by such systems.

Previous research had indicated that GISs may be inadequately tested. The framework developed for GISs testing provided a systematic testing approach, reducing the likelihood of errors in such systems.

Focuses on good practice and ethical concerns around general occupational test usage. Exemplifies this through a UK survey of test practices and a short case study of one organization in the north west of England which has evolved a sustainable quality approach. Competency‐based qualifications form the basis of a UK national standard backed by professional codes of practice. They have had a positive impact on the quality of test use and training. However, evidence is reported to suggest that a number of organizations are not operating to the desirable levels of good practice. Examines through discussion and a case study additional avenues, in particular continuing professional development, that may be explored to promote quality test usage in line with ethical and good practice.

The purpose of this paper is to present the findings of an academic library's implementation of a discovery layer (VuFind 1.0 RC1) as a next‐generation catalogue, based on usability testing and an online survey.

Usability tests were performed on ten students (eight undergraduates, two graduates), asking a set of 14 task‐oriented questions about the customized VuFind interface. Task completion was scored using a simple formula to generate a percentage indicating success or failure. Changes to the interface were made based on resulting scores and on feedback and observations of users during testing. An online survey was also run for three weeks, to which 75 people responded. The results were analyzed, compared and cross‐tested with the findings of the usability testing.

Both the usability testing and survey demonstrated that users preferred VuFind's interface over the classic catalogue. They particularly liked the facets and the richness of the search results listings. Users intuitively understood how to use the deconcatenated Library of Congress Subject Headings. Despite the discovery layer's new functionality, known journal title searching still presents a challenge to users and certain terms used in the interface were problematic.

It is hoped that the findings will assist implementers of VuFind and other next‐generation catalogues to improve their own systems. The questions add to the body of knowledge about usability testing of library catalogues.

No previous papers have been published documenting VuFind usability testing. Not only will the findings be relevant, not just to VuFind, but they will also add to the growing body of literature on next‐generation catalogues.