Search results

The purpose of this paper is to understand how users behave and evaluate how systems with users are essential for interactive information retrieval (IIR) research. User study methodology serves as a primary approach to answering IIR research questions. In addition to designing user study procedures, understanding the limitations of varying study designs and discussing solutions to the limitations is also critical for improving the methods and advancing the knowledge in IIR.

Given this unresolved gap, we apply the faceted framework developed by Liu and Shah (2019) in systematically reviewing 131 IIR user studies recently published (2016–2021) on multiple IR and information science venues.

Our study achieve three goals: (1) extracting and synthesizing the reported limitations on multiple aspects of user study (e.g. recruitment, tasks, study procedures, system interfaces, data analysis methods) under associated facets; (2) summarizing the reported solutions to the limitations; (3) clarifying the connections between types of limitations and types of solutions.

The bibliography of user studies can be used by students and junior researchers who are new to user-centered IR studies as references for study design. Our results can facilitate the reflection and improvement on IR research methodology and serve as a checklist for evaluating customized IIR user studies in varying problem spaces.

To our knowledge, this work is the first study that systematically reviews the study limitations and solutions reported by IIR researchers in articles and empirically examines their connections to different study components.

The purpose of this paper is to report a study of how the test instrument of a simulated work task situation is used in empirical evaluations of interactive information retrieval (IIR) and reported in the research literature. In particular, the author is interested to learn whether the requirements of how to employ simulated work task situations are followed, and whether these requirements call for further highlighting and refinement.

In order to study how simulated work task situations are used, the research literature in question is identified. This is done partly via citation analysis by use of Web of Science®, and partly by systematic search of online repositories. On this basis, 67 individual publications were identified and they constitute the sample of analysis.

The analysis reveals a need for clarifications of how to use simulated work task situations in IIR evaluations. In particular, with respect to the design and creation of realistic simulated work task situations. There is a lack of tailoring of the simulated work task situations to the test participants. Likewise, the requirement to include the test participants’ personal information needs is neglected. Further, there is a need to add and emphasise a requirement to depict the used simulated work task situations when reporting the IIR studies.

Insight about the use of simulated work task situations has implications for test design of IIR studies and hence the knowledge base generated on the basis of such studies.

Simulated work task situations are widely used in IIR studies, and the present study is the first comprehensive study of the intended and unintended use of this test instrument since its introduction in the late 1990’s. The paper addresses the need to carefully design and tailor simulated work task situations to suit the test participants in order to obtain the intended authentic and realistic IIR under study.

The purpose of this paper is to report a study of order effect in interactive information retrieval (IIR) studies. The phenomenon of order effect is well-known, and it is the main reason why searches are permuted (counter-balanced) between test participants in IIR studies. However, the phenomenon is not yet fully understood or investigated in relation to IIR; hence the objective is to increase the knowledge of this phenomenon in the context of IIR as it has implications for test design of IIR studies.

Order effect is studied via partly a literature review and partly an empirical IIR study. The empirical IIR study is designed as a classic between-groups design. The IIR search behaviour was logged and complementary post-search interviews were conducted.

The order effect between groups and within search tasks were measured against nine classic IIR performance parameters of search interaction behaviour. Order effect is seen with respect to three performance parameters (website changes, visit of webpages, and formulation of queries) shown by an increase in activity on the last performed search. Further the theories with respect to motivation, fatigue, and the good-subject effect shed light on how and why order effect may affect test participants’ IR system interaction and search behaviour.

Insight about order effect has implications for test design of IIR studies and hence the knowledge base generated on the basis of such studies. Due to the limited sample of 20 test participants (Library and Information Science (LIS) students) inference statistics is not applicable; hence conclusions can be drawn from this sample of test participants only.

Only few studies in LIS focus on order effect and none from the perspective of IIR.

One core element of interactive information retrieval (IIR) experiments is the assignment of search tasks. The purpose of this paper is to provide an analytical review of current practice in developing those search tasks to test, observe or control task complexity and difficulty.

Over 100 prior studies of IIR were examined in terms of how each defined task complexity and/or difficulty (or related concepts) and subsequently interpreted those concepts in the development of the assigned search tasks.

Search task complexity is found to include three dimensions: multiplicity of subtasks or steps, multiplicity of facets, and indeterminability. Search task difficulty is based on an interaction between the search task and the attributes of the searcher or the attributes of the search situation. The paper highlights the anomalies in our use of these two concepts, concluding with suggestions for future methodological research related to search task complexity and difficulty.

By analyzing and synthesizing current practices, this paper provides guidance for future experiments in IIR that involve these two constructs.

Arts-integration is a promising approach to building students’ abilities to create and critique arguments with data, also known as informal inferential reasoning (IIR). However, differences in disciplinary practices and routines, as well as school organization and culture, can pose barriers to subject integration. The purpose of this study is to describe synergies and tensions between data science and the arts, and how these can create or constrain opportunities for learners to engage in IIR.

The authors co-designed and implemented four arts-integrated data literacy units with 10 teachers of arts and mathematics in middle school classrooms from four different schools in the USA. The data include student-generated artwork and their written rationales, and interviews with teachers and students. Through maximum variation sampling, the authors identified examples from the data to illustrate disciplinary synergies and tensions that appeared to support different IIR processes among students.

Aspects of artistic representation, including embodiment, narrative and visual image; and aspects of the culture of arts, including an emphasis on personal experience, the acknowledgement of subjectivity and considerations for the audience’s perspective, created synergies and tensions that both offered and hindered opportunities for IIR (i.e. going beyond data, using data as evidence and expressing uncertainty).

This study answers calls for humanistic approaches to data literacy education. It contributes an interdisciplinary perspective on data literacy that complements other context-oriented perspectives on data science. This study also offers recommendations for how designers and educators can capitalize on synergies and mitigate tensions between domains to promote successful IIR in arts-integrated data literacy education.

Interactive information retrieval (IR) involves many human cognitive shifts at different information behaviour levels. Cognitive science defines a cognitive shift or shift in cognitive focus as triggered by the brain's response and change due to some external force. This paper aims to provide an explication of the concept of “cognitive shift” and then report results from a study replicating Spink's study of cognitive shifts during interactive IR. This work aims to generate promising insights into aspects of cognitive shifts during interactive IR and a new IR evaluation measure – information problem shift.

The study participants (n=9) conducted an online search on an in‐depth personal medical information problem. Data analysed included the pre‐ and post‐search questionnaires completed by each study participant. Implications for web services and further research are discussed.

Key findings replicated the results in Spink's study, including: all study participants reported some level of cognitive shift in their information problem, information seeking and personal knowledge due to their search interaction; and different study participants reported different levels of cognitive shift. Some study participants reported major cognitive shifts in various user‐based variables such as information problem or information‐seeking stage. Unlike Spink's study, no participant experienced a negative shift in their information problem stage or level of information problem understanding.

This study builds on the previous study by Spink using a different dataset. The paper provides valuable insights for further research into cognitive shifts during interactive IR.

The purpose of this paper is to investigate information retrieval (IR) in the context of authentic work tasks (WTs), as compared to traditional experimental IR study designs.

The participants were 22 professionals working in municipal administration, university research and education, and commercial companies. The data comprise 286 WTs and 420 search tasks (STs). The data were collected in natural situations. It includes transaction logs, video recordings, interviews, observation, and daily questionnaires.

The analysis included the effects of WT type and complexity on the number of STs, queries, search keys and types of queries. The findings suggest that simple STs are enough to support most WTs. Complex WTs (vs more simple ones) and intellectual WTs (vs communication, support and editing WTs) include more STs than other WT categories.

Further research should address the problems related to controllability of field studies and enhance the use of realistic WT situations in test-based studies, as well.

The study is an attempt to bring traditional IR studies and realistic research settings closer to each other. Using authentic WTs when studying IR is still rare. The representativeness of the WT/ST types used in interactive IR experiments should be carefully addressed: in the work flow, people seldom consciously recognise separate “STs”. This means that STs may mainly be an academic construct even to the point that studying IR without a decent context does violence to the further understanding of the phenomenon.

This paper aims to review the situation of decent work (DW) and quality of work life (QWL) in the context of Nepal.

The paper is based on a literature survey. Institutional arrangements for DW and QWL are studied in connection with current labor legislations, national policy documents, and company policies and initiatives. The status of DW and QWL is described, examining national policy documents published by the Government of Nepal, National Planning Commission, labor legislations, International Labor Organization (ILO) and other relevant literature.

At present, although the country has been successful in reducing the number of people under the poverty line, there are challenges in meeting the DW goals. In the case of QWL, since there is rising dissatisfaction among employers and employees in the present economic and political circumstances, they are interested in short‐term benefits.

There are a number of factors affecting DW and QWL. In this paper only national economic and social conditions, poverty level, employment situation and income generation are considered for analysis. The analysis of the QWL situation is done only on the basis of published information rather than using primary sources of information.

The findings of this study will have a number of implications in understanding and improving the level of current institutional arrangements in order to ensure DW and QWL. The observations made in this paper can add some value in the process of formulation of national policy for, and regulation of DW. The issues discussed will have substantial implication for the development and framing of new labor laws and policies.

The paper focuses on DW and QWL for the first time in the Nepalese context. This is an original contribution by the authors to familiarize readers with the situation of DW and QWL in Nepalese organizations.

This study aims to identify user perception of different qualities of optical character recognition (OCR) in texts. The purpose of this paper is to study the effect of different quality OCR on users' subjective perception through an interactive information retrieval task with a collection of one digitized historical Finnish newspaper.

This study is based on the simulated work task model used in interactive information retrieval. Thirty-two users made searches to an article collection of Finnish newspaper Uusi Suometar 1869–1918 which consists of ca. 1.45 million autosegmented articles. The article search database had two versions of each article with different quality OCR. Each user performed six pre-formulated and six self-formulated short queries and evaluated subjectively the top 10 results using a graded relevance scale of 0–3. Users were not informed about the OCR quality differences of the otherwise identical articles.

The main result of the study is that improved OCR quality affects subjective user perception of historical newspaper articles positively: higher relevance scores are given to better-quality texts.

To the best of the authors’ knowledge, this simulated interactive work task experiment is the first one showing empirically that users' subjective relevance assessments are affected by a change in the quality of an optically read text.

The purpose of this paper is to examine perceived self-efficacy of users within an interactive video retrieval context. The motivation for this research includes that understanding self-efficacy will provide insight on how potential users target resources and in turn promote and sustain use of retrieval tools and systems.

A survey method was employed. In total, 270 participants rated levels of perceived self-efficacy for successfully fulfilling different video needs if using a particular system. Perceived self-efficacy was explored quantitatively, both overall and across different potentially influential factors, such as topic type, topic familiarity, system experience, and system context. In addition, open-ended responses on the survey were categorized through content-analysis and subsequently analyzed using weighted frequencies.

Findings demonstrated significant associations between participants’ perceived self-efficacy and different topical factors, including familiarity and topic type, and also system factors, such as exposure (or experience) and system context.

User confidence is one belief or attitude about technology acceptance, with self-efficacy intersecting multiple factors related to initial and sustained use of technologies. Findings give researchers a look at users’ preconceptions of interactive video retrieval situations, which, in turn, suggest positive implications for future research and design.

Video retrieval comprises considerations that are unique from other contexts due to the structure and physical makeup of video. However, until now, self-efficacy has not been directly examined in relation to video or according to several of the specific retrieval factors as explored in the current study, which is thus warranted.