Search results

This study aims to explore a framework for evaluating and comparing two federated search tools (FSTs) using two different retrieval protocols: XML gateways and Z39.50. FSTs are meta-information retrieval systems developed to facilitate the searching of multiple resources through a single search box. FSTs allow searching of heterogeneous platforms, such as bibliographic and full-text databases, online public access catalogues, web search engines and open-access resources.

The proposed framework consists of three phases: the usability testing, retrievability performance assessment and overall comparison. The think-aloud protocol was implemented for usability testing and FSTs retrieval consistency, and precision tests were carried out to assess the retrievability performance for 20 real user queries.

Participants were directed to assign weights for the interface usability and system retrievability importance as indicators for FST evaluation. Results indicated that FSTs retrievability performance was of more importance than the interface usability. Participants assigned an average weight of 62 per cent for the system retrievability and 38 per cent for interface usability. In terms of the usability test, there was no significant difference between the two FSTs, while minor differences were found regarding retrieval consistency and precision at 11-point cut-off recall. The overall evaluation showed that the FST based on the XML gateway rated slightly higher than the FST based on the Z39.50 protocol.

This empirical study faced several limitations. First, the lack of participants’ familiarity with usability testing created the need for a deep awareness and rigorous supervision. Second, the difficulties of empirically assessing participants’ perspectives and future attitudes called for mixing between a formal task and the think-aloud protocol for participants in a real environment. This has been a challenge that faced the collection of the usability data including user behaviour, expectations and other empirical data. Third, the differences between the two FSTs in terms of number of connectors and advanced search techniques required setting rigorous procedures for testing FSTs retrieval consistency and precision.

This paper has practical implications in two dimensions. First, its results could be utilized by FST developers to enhance their product’s performance. Second, the framework could be used by librarians to evaluate FSTs performance and capabilities. The framework enables them to compare between library systems in general and FSTs in particular. In addition to these practical implications, the authors encourage researchers to use and enhance the proposed framework.

Librarians can use the proposed framework to empirically select an FST, involving users in the selection procedures of these information retrieval systems, so that it accords with users’ perspectives and attitudes and serves the community better.

The proposed framework could be considered a benchmark for FST evaluation.

The purpose of this empirical study was to address two important concerns of Web usability: how user-intuitive interface signs affect Web usability and how applying semiotics (i.e. the doctrine of signs) in user interface (UI) design and evaluation helps to improve usability.

An empirical research approach is followed here to conduct three user tests. These tests were conducted on a Web application with 17 test participants. Data were gathered through laboratory-based think-aloud usability test, questionnaires and interviews. Following an empirical research approach, statistics and user behavior analysis were used to analyze the data.

This study explores two important concerns of UI design and evaluation. First, users’ interpretation accuracy of interface signs impact on Web usability. The study found that users’ interpretation of signs might be accurate, moderate, conflicting, erroneous or incapable; user-intuitive interface signs led participants to interpret signs’ meaning accurately; and users’ inaccurate interpretation of one or a few task-related interface sign(s) led users to usability problems, resulting in participants performing tasks with lower task-completion performance. Second, considering semiotics perception in UI design and evaluation is important to improve Web usability. This study showed that interface signs, when re-designed considering the semiotics guidelines, have increased the end-users’ interpretation accuracy and the interface signs’ intuitiveness. This study also provides a small set of semiotics guidelines for sign design and evaluation.

This study empirically demonstrated that signs’ intuitiveness impact on Web usability and that considering the semiotics perception in sign design and evaluation is important to improve Web usability. These outcomes are valuable in a number of ways to HCI researchers and practitioners: the results provide awareness of the importance of user-intuitive interface signs in UI design; practitioners can easily adopt the concept of interpretation accuracy classification to conduct a sign test to obtain an “overall impression of interface signs’ intuitiveness”; practitioners can easily adopt the methodological approach followed in this study to conduct usability test without additional resources; and the results raised important fundamental questions for future research such as “what does a practitioner need to be aware of when designing or evaluating interface signs?”

Usability testing using think aloud protocols was conducted on the MetaLib interface, a new federated search product soon to be offered by the university libraries. The object of the testing was to find problems users might experience with the MetaLib interface in order to improve site usability.

Based on responses to a demographic questionnaire, a representative sample of eight volunteers, diverse with respect to affiliation, discipline, gender, language, and computer expertise was selected. Using the MetaLib interface and guided by a moderator, participants completed real‐world tasks while verbalizing their thoughts. Participants also completed a questionnaire and answered three open‐ended items. Transcripts provided the data for the study, which were used to determine problems and difficulties with the interface.

The usability testing revealed one critical issue, that is, problems with the login. Other issues included problems with primary and secondary navigation, confusing terminology, and inconsistency with the site design and user expectations.

This was a qualitative study and results should not be used to generalize to a larger population, but rather to identify issues with usability.

The issues identified will provide feedback that will be used to address the usability of the software and the design of training, tutorials, and quick guides.

Results of this study will add to the body of information about the usability of a federated search product and can help others to select and/or design a usable product. This study can also be used for the future improvement of the MetaLib product.

The paper aims to evaluate the usability of the website of Central Science Library (CSL), University of Delhi. Multi-method approach of evaluation is used with the use of standard checklist and questionnaire survey of representative users. Besides, the information architecture of the website under study is analysed in this paper.

Based on the literature review and the author’s experience, a usability assessment tool for library websites was developed by Pant (2013). It comprises standard checklist and questionnaire for users’ survey. In the present study, this framework was used to assess the usability of CSL website. The questionnaire survey of 35 representative users was conducted through random sampling. The results of both methods (standard checklist and questionnaire survey) were analysed for evaluating the website usability.

Need for improvement of the website was realised in terms of efficiency, effectiveness and learnability for better usability. Notice board, site search facility, list of services, FAQs and user guides were the most sought after features among others as per the analysis of the questionnaire survey. Besides, the need to enhance the visual appeal of the website was felt. However, information resources provided through the CSL website were found useful for users.

The paper presents an innovative multi-method approach of website usability assessment while considering six usability attributes: Usefulness, Efficiency, Effectiveness, Learnability, Satisfaction and Accessibility. The approach adopted in this paper is cost effective in comparison to formal usability tests and heuristic evaluation. Therefore, this framework is suitable for libraries having limited budget to ensure the user-centred library website with maximum usability. This paper encourages other libraries to conduct similar website usability evaluation to identify the usability problem areas and users’ perception for their respective website.

This paper seeks to present a usability evaluation of the web site of the Main Library of the St Augustine Campus of the University of the West Indies (UWI) to get users and site visitors to identify the major strengths and weaknesses of the site and to incorporate the results and participant feedback into a redesign that reflects users' intuitions rather than those of the site developers and librarians.

A combination of experimental and respondent research strategies was used to evaluate usability. These included survey questionnaires, focus groups, formal usability testing and card sort. In addition, both usability heuristics and ISO guidelines were used to assess effectiveness, learnability, usefulness and user satisfaction. Respondent strategies used a sample size of 529 participants for the self‐completion questionnaires and 16 participants in the focus group sessions. Experimental strategies combined observation of 21 individual participants and three groups of participants in the usability tests. In the card sort protocol nine individual participants and three groups of participants were observed.

The findings identified challenges in the site's information architecture (labelling and organisation) and in the interface design.

More ethnographic approaches are needed to elicit distinctive Caribbean user behaviours.

The study concludes that similar usability evaluations should be undertaken at the other UWI campus library web sites and that usability training should be incorporated into the culture of the library organisation. Critical next steps for the web designer are also suggested.

The paper presents issues of organisational change and the impact of technology on the relationship between systems and user services librarians.

The purpose of this study is to develop and evaluate the use of a library mobile website at a university library. This paper aims to present the approach adopted to investigate users’ reactions to the new mobile platform. A usability test was also conducted to examine its effectiveness.

Mobile websites for academic libraries were first reviewed prior to identifying the functions and elements to be included. To assess the intended design purpose, the usability of the design was examined through a comparison of the mobile website and the full PC website used by 50 students to accomplish a set of search tasks. A questionnaire survey was used to assess 336 students’ responses regarding various criteria including learnability, control, presentation and efficiency.

The usability test that was conducted before the mobile Web was formally released indicated that the students using it finished more search tasks (p < 0.001), and were more efficient in completing search tasks than they were using the PC website (p < 0.001). Data from 336 questionnaire responses also indicated the students’ positive reactions to the developed mobile system in four defined facets (mean >= 4.0).

The difficulty of recruiting volunteers and the small number of subjects who participated was also a major limitation experienced in this study. Replications or use of different measurements might be needed in future research to confirm the result.

In this study, a library mobile website was developed, tested and evaluated by users. Currently, the library mobile website is being implemented in the university. On-going revisions will continue to improve its effectiveness and efficiency for information retrieval.

It is expected that through the library mobile services, a ubiquitous learning environment can be provided to students to fulfil their academic and leisure needs.

Summative evaluation of the mobile system revealed the students’ positive reactions to a set of predetermined criteria in various dimensions, including: learnability, control, presentation and efficiency.

Fischer et al. (2022) present a framework for rethinking education, including broad design components such as learning-on-demand or learning takes place in the context of authentic problems. How can we bring those design components into practice? I argue that the design of innovative learning approaches for the digital age requires rigor in design and evaluation methods to understand what works and how and why it works.

This case study applies the research to improve approach with iterative steps of design, development, and formative evaluation. Methods to be used are borrowed from user and learning experience fields, such as usability studies and pre/posttests for learning growth.

The design of digital learning experiences rests on the three dimensions of how learners interact with (a) the digital tool, space, or service; (b) the pedagogical elements of goals, activities, and assessments (e.g. sense-making); and (c) other peers or instructors.

This study provides useful insights on how to conduct research to improve versus research to prove and indicates the importance of data analysis related to the effectiveness, efficiency, and attractiveness of digital learning experiences. Learning experience design and research provides sufficient rigor and could play an important role in new ways of learning in the digital age with the goal “making learning a part of life” as pointed out by Fischer et al. (2022).

The purpose of this paper is to provide a selected bibliography of recent resources on library instruction and information literacy.

Introduces and annotates periodical articles, monographs, and audiovisual material examining library instruction and information literacy.

Provides information about each source, discusses the characteristics of current scholarship, and describes sources that contain unique scholarly contributions and quality reproductions.

The information may be used by librarians and interested parties as a quick reference to literature on library instruction and information literacy.

Library websites serve as gateways to the information resources and services of their libraries. In today’s digital age, the development of websites is inevitable for libraries as a means to provide users with online services at their desktops. This case study reports the findings of a usability study of an academic library website from the user’s perspective.

An online survey on the efficacy of the website and statistical reports from Google Analytics were used as tools to assess and track the use of the Commission on Science and Technology for Sustainable Development in the South (COMSATS) Institute of Information Technology’s (CIIT’s) library website resources by national and international users. A sample of 550 users was invited by e-mail to respond to the questionnaire covering various usability features of the website.

Findings reveal that users are largely satisfied with the usefulness, convenience, design and quality of CIIT library website. Moreover, the users are mostly making use of the website for accessing research papers through the Higher Education Commission (HEC) digital library, exploring free online open access journals, searching for e-books and examining the library collection via online public access catalog (OPAC). This shows that the library website has a significant role in the pedagogical activities of the CIIT community.

The results are limited to a case study of CIIT, Islamabad campus library website.

The findings of this study will help the library administration to overcome existing deficiencies in the CIIT library website.

The study is a foremost usability evaluation of CIIT, Islamabad campus library website from the user perspective.

This paper aims to present recently published resources on library instruction and information literacy, providing an introductory overview and a selected annotated bibliography of publications covering various library types, study populations and research contexts.

This paper introduces and annotates English-language periodical articles, monographs, dissertations, reports and other materials on library instruction and information literacy published in 2019.

The paper provides a brief description of all 370 sources and highlights sources that contain unique or significant scholarly contributions.

The information may be used by librarians, researchers and anyone interested as a quick and comprehensive reference to literature on library instruction and information literacy.