Search results
1 – 10 of over 85000Pak-Lok Poon, Fei-Ching Kuo, Huai Liu and Tsong Yueh Chen
An alarming number of spreadsheet faults have been reported in the literature, indicating that effective and easy-to-apply spreadsheet testing techniques are not available for…
Abstract
Purpose
An alarming number of spreadsheet faults have been reported in the literature, indicating that effective and easy-to-apply spreadsheet testing techniques are not available for “non-technical,” end-user programmers. The purpose of this paper is to alleviate the problem by introducing a metamorphic testing (MT) technique for spreadsheets.
Design/methodology/approach
The paper discussed four common challenges encountered by end-user programmers when testing a spreadsheet. The MT technique was then discussed and how it could be used to solve the common challenges was explained. An experiment involving several “real-world” spreadsheets was performed to determine the viability and effectiveness of MT.
Findings
The experiment confirmed that MT is highly effective in spreadsheet fault detection, and yet MT is a general technique that can be easily used by end-user programmers to test a large variety of spreadsheet applications.
Originality/value
The paper provides a detailed discussion of some common challenges of spreadsheet testing encountered by end-user programmers. To the best of the authors knowledge, the paper is the first that includes an empirical study of how effective MT is in spreadsheet fault detection from an end-user programmer's perspective.
Details
Keywords
The purpose of this paper is to investigate usability testing methods currently in use outside of library science, primarily in the business world, and to find important…
Abstract
Purpose
The purpose of this paper is to investigate usability testing methods currently in use outside of library science, primarily in the business world, and to find important techniques that can be applied to library science to improve usability testing in libraries.
Design/methodology/approach
Objectives are achieved through a review of the business literature on qualitative and quantitative web site usability testing. The approach to the topic is based on an assumption that businesses are constantly refining their testing methods in order to make a profit; therefore, their testing methods are evolving and may ultimately be more efficient and effective than the techniques currently in use in libraries. Because businesses are dependent on consumer choice, they must provide user‐friendly web interfaces developed out of usability testing.
Findings
The findings of this paper illustrate that there are many useful kernels of information about testing that can be gleaned from the business literature and applied to testing in a library environment. Testing methods not in use in libraries that are covered include: process‐oriented testing, side‐by‐side testing, hybrid testing, and unique qualitative data gathering methods.
Practical implications
There are many testing methods discussed in this paper that can be implemented in libraries. The paper suggests how these methods can be adapted to fit a library testing setting and improve the current testing process in place in most libraries. Improved testing methods will ultimately result in improved web site interfaces, which will increase user access to information and help libraries fulfill their missions to make information and online resources accessible to all.
Originality/value
Usability testing methods currently not in use in libraries are proposed. The methods discussed can help librarians change and improve their testing methodologies in order to help libraries compete in the increasingly crowded information marketplace.
Details
Keywords
Layla Hasan, Anne Morris and Steve Probets
The purpose of this paper is to develop a methodological usability evaluation approach for e‐commerce websites in developing countries.
Abstract
Purpose
The purpose of this paper is to develop a methodological usability evaluation approach for e‐commerce websites in developing countries.
Design/methodology/approach
A multi‐faceted usability evaluation of three Jordanian e‐commerce websites was used, where three usability methods (user testing, heuristic evaluation and web analytics) were applied to the sites.
Findings
A four‐step approach was developed to facilitate the evaluation of e‐commerce sites, mindful of the advantages and disadvantages of the methods used in identifying specific usability problems.
Research limitations/implications
The approach was developed and tested using Jordanian users, experts and e‐commerce sites. The study compared the ability of the methods to detect problems that were present, however, usability issues not present on any of the sites could not be considered when creating the approach.
Practical implications
The approach helps e‐commerce retailers evaluate the usability of their websites and understand which usability method(s) best matches their need.
Originality/value
This research proposes a new approach for evaluating the usability of e‐commerce sites. A novel aspect is the use of web analytics (Google Analytics software) as a component in the usability evaluation in conjunction with heuristics and user testing.
Details
Keywords
The purpose of this paper is to describes the methods and findings of two research projects undertaken to explore user behaviour and usability issues relating to the use of…
Abstract
Purpose
The purpose of this paper is to describes the methods and findings of two research projects undertaken to explore user behaviour and usability issues relating to the use of Web‐based resources by people with disabilities.
Design/methodology/approach
Whilst the aims of the research differed, the methods adopted were similar – including observation, talk aloud protocols, questionnaires and focus groups.
Findings
The findings from both studies provided evidence of the problems faced by disabled users when using Web‐based resources. It provided evidence of the types of features users liked and disliked, how they overcame navigational problems and what types of features enhanced their experience, all of which can be fed back into recommendations for the design of electronic resources.
Practical implications
The richness of the data collected for both studies confirmed the importance of involving users in accessibility and usability assessments. Analysis of both the findings and the methods for both studies also enabled a checklist to be developed, outlining issues that should be taken into consideration when planning a usability test.
Originality/value
Document analysis of past and current usability studies revealed that suggested methods are often directed more towards expert usability testing, rather than managing the user testing in‐house. Although it may be preferable to engage an expert, in reality practical guidance is also needed. The checklist aims to address gaps in usability advice identified, by providing practical guidance to enable providers and developers of web‐based resources to conduct their own effective usability testing.
Details
Keywords
The purpose of this paper is to describe a case study of the development, features and evaluation of a rich internet application for libraries. It aims to demonstrate best…
Abstract
Purpose
The purpose of this paper is to describe a case study of the development, features and evaluation of a rich internet application for libraries. It aims to demonstrate best practice in the use of software standards, development processes and evaluation.
Design/methodology/approach
Web 2.0, open source design methods and usability testing were used within an agile framework.
Findings
The adoption of agile software development methods, coupled with usability testing, would enable the library community to take full advantage of the techniques and principles inherent in Web 2.0 open source software.
Research limitations/implications
A major component of the evaluation of OJAX was a series of usability tests. As is the nature of most usability studies, the results are not generalisable.
Originality/value
Aspects of agile software development methods, such as usability testing and iterative design, are recognised in the literature as contributing to the usability of library software. However, exploration of the use of a full agile framework plus usability testing to facilitate Web 2.0 open source software is rare in library‐related literature.
Details
Keywords
The aim of this paper is to discuss the application of a web‐based tool as a remote asynchronous usability testing method based on an assessment of an academic library's digital…
Abstract
Purpose
The aim of this paper is to discuss the application of a web‐based tool as a remote asynchronous usability testing method based on an assessment of an academic library's digital collections website.
Design/methodology/approach
The paper examines the selection of an asynchronous remote usability testing method, the reasons for the selection of SurveyMonkey, an evaluation of its effectiveness through an assessment of the digital collections web site, and the potential for its application in future usability studies.
Findings
SurveyMonkey can be employed as an assessment tool with advance planning by evaluators to capture the responses and opinions of users. Overall, it is a cost effective and time‐saving option for small assessment projects.
Research limitations/implications
This was an informal study where a specific product, SurveyMonkey, was tested with the purpose of evaluating its effectiveness as a remote asynchronous assessment tool through its application for a specific website usability study. The assessment was not compared to other testing methods, and the tool was not evaluated through formal methods.
Practical implications
Libraries and other organizations can look to free, or low‐cost, web‐based tools as an alternative to more traditional methods, such as focus groups, when evaluating services.
Originality/value
The paper describes the creation and implementation of a web‐based usability test for a library website using a specific product. It looks at the effectiveness of the assessment tool based on cost and time requirements, in addition to the benefits and disadvantages of conducting remote usability testing.
Details
Keywords
Focuses on good practice and ethical concerns around general occupational test usage. Exemplifies this through a UK survey of test practices and a short case study of one…
Abstract
Focuses on good practice and ethical concerns around general occupational test usage. Exemplifies this through a UK survey of test practices and a short case study of one organization in the north west of England which has evolved a sustainable quality approach. Competency‐based qualifications form the basis of a UK national standard backed by professional codes of practice. They have had a positive impact on the quality of test use and training. However, evidence is reported to suggest that a number of organizations are not operating to the desirable levels of good practice. Examines through discussion and a case study additional avenues, in particular continuing professional development, that may be explored to promote quality test usage in line with ethical and good practice.
Details
Keywords
Usability testing of Web interfaces for virtual libraries is a crucial factor in the continuing development and improvement of the user interface. In 1999, the University of South…
Abstract
Usability testing of Web interfaces for virtual libraries is a crucial factor in the continuing development and improvement of the user interface. In 1999, the University of South Florida Libraries decided to embark on a usability study to coincide with the rollout of a new interface design. Because this type of study had not been conducted with the initial interface, its implementation and completion were paramount in the development of the new design. Details the preliminary activities, testing methodologies and results of usability testing by the USF virtual library project’s usability study group.
Details
Keywords
Mark Taylor, Emma Higgins and Paulo Lisboa
The purpose of this paper is to describe the development and evaluation of a geographical information system (GIS) testing framework that was used to test a fire prevention…
Abstract
Purpose
The purpose of this paper is to describe the development and evaluation of a geographical information system (GIS) testing framework that was used to test a fire prevention support GIS.
Design/methodology/approach
A year‐long case study was undertaken concerning the testing of a fire prevention support GIS in a UK fire and rescue service.
Findings
The GIS testing framework developed involved testing the different components of a GIS, testing their interactions, and then testing the system as a whole. Since GISs contain different components such as spatial analyses and map‐based output, this supports the adoption of a different testing framework compared to existing types of information systems.
Research limitations/implications
GISs will typically be used by organisations for decision making. Clearly if the information presented by a GIS is inaccurate, unrepresentative, or unreliable, then the decision‐making process can be undermined.
Practical implications
This is particularly important with regard to GISs used by emergency services (such as the fire and rescue service studied) where lives could potentially be put at risk by erroneous information provided by such systems.
Originality/value
Previous research had indicated that GISs may be inadequately tested. The framework developed for GISs testing provided a systematic testing approach, reducing the likelihood of errors in such systems.
Details
Keywords
William Denton and Sarah J. Coysh
The purpose of this paper is to present the findings of an academic library's implementation of a discovery layer (VuFind 1.0 RC1) as a next‐generation catalogue, based on…
Abstract
Purpose
The purpose of this paper is to present the findings of an academic library's implementation of a discovery layer (VuFind 1.0 RC1) as a next‐generation catalogue, based on usability testing and an online survey.
Design/methodology/approach
Usability tests were performed on ten students (eight undergraduates, two graduates), asking a set of 14 task‐oriented questions about the customized VuFind interface. Task completion was scored using a simple formula to generate a percentage indicating success or failure. Changes to the interface were made based on resulting scores and on feedback and observations of users during testing. An online survey was also run for three weeks, to which 75 people responded. The results were analyzed, compared and cross‐tested with the findings of the usability testing.
Findings
Both the usability testing and survey demonstrated that users preferred VuFind's interface over the classic catalogue. They particularly liked the facets and the richness of the search results listings. Users intuitively understood how to use the deconcatenated Library of Congress Subject Headings. Despite the discovery layer's new functionality, known journal title searching still presents a challenge to users and certain terms used in the interface were problematic.
Practical implications
It is hoped that the findings will assist implementers of VuFind and other next‐generation catalogues to improve their own systems. The questions add to the body of knowledge about usability testing of library catalogues.
Originality/value
No previous papers have been published documenting VuFind usability testing. Not only will the findings be relevant, not just to VuFind, but they will also add to the growing body of literature on next‐generation catalogues.
Details