Search results

The purpose of this paper is to understand how users behave and evaluate how systems with users are essential for interactive information retrieval (IIR) research. User study methodology serves as a primary approach to answering IIR research questions. In addition to designing user study procedures, understanding the limitations of varying study designs and discussing solutions to the limitations is also critical for improving the methods and advancing the knowledge in IIR.

Given this unresolved gap, we apply the faceted framework developed by Liu and Shah (2019) in systematically reviewing 131 IIR user studies recently published (2016–2021) on multiple IR and information science venues.

Our study achieve three goals: (1) extracting and synthesizing the reported limitations on multiple aspects of user study (e.g. recruitment, tasks, study procedures, system interfaces, data analysis methods) under associated facets; (2) summarizing the reported solutions to the limitations; (3) clarifying the connections between types of limitations and types of solutions.

The bibliography of user studies can be used by students and junior researchers who are new to user-centered IR studies as references for study design. Our results can facilitate the reflection and improvement on IR research methodology and serve as a checklist for evaluating customized IIR user studies in varying problem spaces.

To our knowledge, this work is the first study that systematically reviews the study limitations and solutions reported by IIR researchers in articles and empirically examines their connections to different study components.

The purpose of this paper is to present a framework applicable to interactive video retrieval. The objective of the framework is so that it can be applied conceptually for understanding users and use of video digital libraries, and also practically for designing retrieval components like user interfaces.

The framework was developed through a user-centered and analytical approach, and serves as an initial attempt at generalizing how users interact when searching and browsing digital video, throughout different situations, along with the general designs that can be supportive.

The framework is two-fold, yet, together, comprises one set of conceptual findings. The first component of the framework depicts generalized user interactions throughout varying contexts of an interactive video retrieval process, followed by a second component, an illustration of the resulting supportive interface designs or sets of features. Cautions from previous studies not to over generalize the interactive process were heeded.

The implications for such research are based on the understanding that video retrieval will benefit from the advancement of user-centered foundations, which can guide and support design decisions for resources like digital libraries.

The need for this study is rather straightforward: there is currently not enough conceptual research of interactive video retrieval from a user-centered perspective, which contrasts with other areas of information retrieval research where the interaction process has been thoroughly examined for a variety of domains and contexts with implications for different retrieval tools like OPACs, search engines, and article databases.

With the vast amount of multilingual information available online, it becomes increasingly critical for libraries to use various multilingual information access techniques in order to effectively support patrons' online information requests. However, this is still a relatively under‐explored area. This paper aims to study the effectiveness and the adoptability of query expansion and translation enhancement in the context of interactive multilingual information access.

Relying on an interactive multilingual information access system called ICE‐TEA, the authors conducted a controlled experiment (English‐to‐Chinese translation) involving human subjects to assess the retrieval effectiveness, analyzed the collected search logs to examine users' behavior, and employed pre‐ and post‐questionnaires to obtain users' opinions about the system.

The results confirm that significant improvement in retrieval effectiveness can be achieved by combining query expansion with translation enhancement (as compared to a case when there is no relevance feedback). However, users' ability to understand, interact with and even perceive the complex process of searches involving the combination of query expansion and translation enhancement may greatly impact the effectiveness of the techniques. The results also confirm that human‐generated queries were short queries, which calls for careful consideration of how longer queries perform in real search because many search engines rely on longer and more complex queries.

This study examines two important relevance feedback techniques in the context of human‐involved multilingual information access. This study is a valuable addition to the information seeking behaviour literature.

Query expansion and query limitation are two known techniques for assisting users to define efficient queries. The purpose of this article is to examine the effectiveness of the two methods.

The research entailed an objective and subjective evaluation of the effectiveness of automatic and interactive query expansion and of two query limit options. The evaluation included both lab simulations and large‐scale user studies. The objective aspects were evaluated in lab simulations with experts judging user performance. The subjective analysis was carried out by having the participants evaluate the quality of, and express their satisfaction with, the retrieval process and its results, thus employing perceived‐value analysis.

The main findings reveal a difference between the perceived and real values of these techniques. While users expressed their satisfaction with interactive query expansion and its performance, the real‐value analysis of their performance did not show any significant difference between the retrieval modes.

The article evaluates the objective and subjective effectiveness of automatic and interactive query expansion and two query limit options.

This article aims to examine how the interactions and perceptions of users from a defined domain, i.e. science education, vary across different groups of teachers while retrieving video. Given the prevalence of digital resources in use in education today, it is critical to assess users’ perspectives and experiences for retrieving information across different contexts and individual user groups.

Interactive search experiments with 28 users were performed. A pre-experiment questionnaire collected the demographic information used to form groups for comparison in the present study. Users attempted six experimenter-developed topics using a prototype video retrieval system; experimental measures were recorded, including all actions, completion rates, errors and durations. Users rated their experiences and levels of satisfaction with different aspect of the system after each search topic. Data analyses included mean comparisons across the different groups.

A variety of influences emerged from the results, including significant variations among teachers’ interactions, levels of satisfaction and expectations across different groups of users.

Understanding the interactions and perceptions when retrieving digital video provides insights for information professionals on how to better support the needs of different users. If systems are not taking into account users and context, there can be a mismatch between the needs of users and interactive systems, which can lead to low perceptions and further underuse of digital resources.

Although similar influences on digital libraries have been analysed in other contexts, they have not been directly assessed, as they specifically pertain to experiences with and perceptions of video.

This paper presents a set of basic components which constitutes the experimental setting intended for the evaluation of interactive information retrieval (IIR) systems, the aim of which is to facilitate evaluation of IIR systems in a way which is as close as possible to realistic IR processes. The experimental setting consists of three components: (1) the involvement of potential users as test persons; (2) the application of dynamic and individual information needs; and (3) the use of multidimensional and dynamic relevance judgements. Hidden under the information need component is the essential central sub‐component, the simulated work task situation, the tool that triggers the (simulated) dynamic information needs. This paper also reports on the empirical findings of the metaevaluation of the application of this sub‐component, the purpose of which is to discover whether the application of simulated work task situations to future evaluation of IIR systems can be recommended. Investigations are carried out to determine whether any search behavioural differences exist between test persons‘ treatment of their own real information needs versus simulated information needs. The hypothesis is that if no difference exists one can correctly substitute real information needs with simulated information needs through the application of simulated work task situations. The empirical results of the meta‐evaluation provide positive evidence for the application of simulated work task situations to the evaluation of IIR systems. The results also indicate that tailoring work task situations to the group of test persons is important in motivating them. Furthermore, the results of the evaluation show that different versions of semantic openness of the simulated situations make no difference to the test persons’ search treatment.

The possibility of having access to all the world's literature from a single computer terminal stimulated the imagination of the research workers in the late' sixties. It was this goal and the fascination of the co‐operation between man and machine, that inspired the major changes that have taken place in Information Retrieval over the past ten years.

The purpose of this paper is to examine perceived self-efficacy of users within an interactive video retrieval context. The motivation for this research includes that understanding self-efficacy will provide insight on how potential users target resources and in turn promote and sustain use of retrieval tools and systems.

A survey method was employed. In total, 270 participants rated levels of perceived self-efficacy for successfully fulfilling different video needs if using a particular system. Perceived self-efficacy was explored quantitatively, both overall and across different potentially influential factors, such as topic type, topic familiarity, system experience, and system context. In addition, open-ended responses on the survey were categorized through content-analysis and subsequently analyzed using weighted frequencies.

Findings demonstrated significant associations between participants’ perceived self-efficacy and different topical factors, including familiarity and topic type, and also system factors, such as exposure (or experience) and system context.

User confidence is one belief or attitude about technology acceptance, with self-efficacy intersecting multiple factors related to initial and sustained use of technologies. Findings give researchers a look at users’ preconceptions of interactive video retrieval situations, which, in turn, suggest positive implications for future research and design.

Video retrieval comprises considerations that are unique from other contexts due to the structure and physical makeup of video. However, until now, self-efficacy has not been directly examined in relation to video or according to several of the specific retrieval factors as explored in the current study, which is thus warranted.

The paper aims to explore the concepts of interaction and interactivity presented in different theoretical models in the fields of human‐computer interaction (HCI) and information‐seeking/searching behaviour, and to relate these to information retrieval (IR) research. It is suggested that interaction in HCI is primarily concerned with establishing a user/system dialogue at the user interface and does not address the interactive characteristics of IR operational tasks. A distinction is made between general informationseeking models and information‐searching models for computerised systems. The former are deemed to provide a useful framework for characterising interaction at the task level, with the structural relationship between tasks as well as the dynamic transition from one task to another being key features of the interactive process. Although the latter are all concerned with how searchers interact with IR systems, each of the models examined represents user interaction at different levels of abstraction. Taken together they provide complementary views of a highly dynamic process. Three principal aspects of interaction are identified and discussed: interaction within and across tasks; the notion of interaction as task sharing; and interaction as a discourse. In conclusion the adoption of an interaction paradigm for IR research is advocated and examples of empirical work for supporting interactive searching and retrieval are provided.

An online library catalogue served as a testbed to evaluate an interactive query expansion facility based on relevance feedback for the Okapi probabilistic term weighting retrieval system. The facility was implemented in a graphical user interface (gui) environment using a game‐board metaphor for the search process, and allowed searchers to select candidate terms extracted from relevant retrieved items to reformulate queries. The take‐up of the interactive query expansion option was found to be lower, and its retrieval performance less effective, compared to previous tests featuring automatic query expansion. Contributory factors including the number, presentation and source of terms are discussed.