Search results

One core element of interactive information retrieval (IIR) experiments is the assignment of search tasks. The purpose of this paper is to provide an analytical review of current practice in developing those search tasks to test, observe or control task complexity and difficulty.

Over 100 prior studies of IIR were examined in terms of how each defined task complexity and/or difficulty (or related concepts) and subsequently interpreted those concepts in the development of the assigned search tasks.

Search task complexity is found to include three dimensions: multiplicity of subtasks or steps, multiplicity of facets, and indeterminability. Search task difficulty is based on an interaction between the search task and the attributes of the searcher or the attributes of the search situation. The paper highlights the anomalies in our use of these two concepts, concluding with suggestions for future methodological research related to search task complexity and difficulty.

By analyzing and synthesizing current practices, this paper provides guidance for future experiments in IIR that involve these two constructs.

The purpose of this paper is to examine the role of task and user’s topic familiarity in the evaluation of information patch (websites).

An experimental study was conducted in a computer laboratory to examine users’ information seeking and foraging behaviour. In total, 160 university students participated in the research. Two types of task instructions, specifically defined and non-specifically defined (general) task types were administered. Mixed methods approach involving both quantitative and qualitative thematic coding were adopted, from the data of the questionnaire surveys and post-experiment interviews.

In the context of task attributes, users who conducted information seeking task with specifically defined instructions, as compared to the non-specifically defined instructions, demonstrated stricter credibility evaluations. Evidence demonstrated the link between topical knowledge and credibility perception. Users with topical knowledge applied critical credibility assessments than users without topical knowledge. Furthermore, the evidential results supported that the level of difficulty and knowledge of the topic or subject matter associated with users’ credibility evaluations. Users who have lesser or no subject knowledge and who experienced difficulty in the information search tended to be less diagnostic in their appraisal of the information patch (website or webpages). Users equipped with topical knowledge and who encountered less difficulty in the search, exhibited higher expectation and evaluative criteria of the information patch.

The constraints of time in the lab experiment, carried out in the presence of and under the observation of the researcher, may affect users’ information seeking behaviour. It would be beneficial to consider users’ information search gratifications and motivations in studying information evaluations and foraging patterns. There is scope to investigate users’ proficiency such as expert or novice, and individual learning styles in assessing information credibility.

Past studies on information evaluation, specifically credibility is often associated with users’ characteristics, source, or contents. This study sheds light on the context of task type, task difficulty and topical knowledge in affecting users’ information judgement.

One of the scarce studies in relating task orientation, task difficulty and topical knowledge to information evaluations.

The purpose of this paper is to study what extent readers’ socio-demographic characteristics, literary preferences and search behavior predict success in fiction search in library catalogs.

In total, 80 readers searched for interesting novels in four differing search tasks. Their search actions were recorded with a Morae Recorder. Pre- and post-questionnaires elicited information about their background, literary preferences and search experience. Readers’ literary preferences were grouped into four orientations by a factor analysis. Linear regression analysis was applied for predicting search success as measured by books’ interest scores.

Most literary orientations contributed to search success, but in differing search tasks. The role of result examination was greater compared to querying in contributing search success almost in each task. The proportion of variance explained in books’ interest scores varied between 5 (open-ended browsing) and 50 percent (analogy search).

The distribution of participants was biased toward females, and the results are aggregated within search session, both reducing the variation of the phenomenon observed.

This study is one of the first to explore how readers’ literary preferences and searching are associated with finding interesting novels, i.e. search success, in library catalogs. The results expand and support the findings in Mikkonen and Vakkari (2017) concerning associations between reader characteristics and fiction search success.

The purpose of this paper is to investigate when and how people working collaboratively could be assisted in a fact-finding task, specifically focusing on team size and its effect on the outcomes of such a task. This is a follow-up to a previously published study that examined exploratory search tasks.

This research investigates the effects of team size on fact-finding tasks using a lab study involving 68 participants – 12 individuals, ten dyads, and 12 triads. The evaluation framework developed in the preceding work is used to compare the findings with respect to the earlier traditional exploratory task (Task 1) and the complex fact-finding task reported here (Task 2), with task type being the only difference.

The analyses of the user study data show that while adding more people to an exploratory search task could be beneficial in terms of efficiency and effectiveness, such findings do not apply in a complex fact-finding task. Indeed, results showed that the individuals were more efficient and effective doing Task 2 than they were in Task 1. Moreover, they outperformed the dyads and triads in Task 2 with respect to these two measures, which relate to the coverage of useful information and its relation to the expression of information needs. If the total time taken by each team is disregarded, the dyads and triads did better than the individuals in answering the fact-finding questions. But considering the time effect, this performance boost does not keep up with the increased group size.

The findings shed light not only on when, how, and why certain collaborations become successful, but also how team size affects specific aspects of information seeking, including information exposure, information relevancy, information search, and performance. This has implications for system designers, information managers, and educators. The presented work is novel in that it is the first empirical work to show the difference in individual and collaborative work (by dyads and triads) between exploratory and fact-finding tasks.

The purpose of this paper is to assess student web searching competency. The paper aims to determine varying levels of university student competency in web searches and to investigate and compare their competency levels of searching academic and daily‐life tasks.

The study adopted a quantitative research method of giving study participants a controllable experiment, a task‐based online test (TBOT), to evaluate web searching competency based on student searching performance. Participants included 141 undergraduate and graduate students from Wuhan University, China. Their searching competency level was assessed by testing their searching effectiveness and searching efficiency.

Student average web searching competency level was found to be comparatively low overall, within preliminary stages of development. A lot of students are unable to search the web with efficiency. Competency levels for searching academic tasks were higher than those of daily‐life tasks, especially when the degree of difficulty increased. These two levels, however, have a significant positive correlationship. In information literacy education it is therefore vital to teach students comprehensive web searching competency that includes knowledge and techniques for both academic and daily‐life search tasks.

Using the TBOT to assess student web searching competency is novel in the field of library and information science. By conducting this pilot experiment, librarians and teachers will be able to design and promote an improved information literacy education according to students' specific web searching competency status, instead of assumed goal levels.

The purpose of this paper is to investigate information retrieval (IR) in the context of authentic work tasks (WTs), as compared to traditional experimental IR study designs.

The participants were 22 professionals working in municipal administration, university research and education, and commercial companies. The data comprise 286 WTs and 420 search tasks (STs). The data were collected in natural situations. It includes transaction logs, video recordings, interviews, observation, and daily questionnaires.

The analysis included the effects of WT type and complexity on the number of STs, queries, search keys and types of queries. The findings suggest that simple STs are enough to support most WTs. Complex WTs (vs more simple ones) and intellectual WTs (vs communication, support and editing WTs) include more STs than other WT categories.

Further research should address the problems related to controllability of field studies and enhance the use of realistic WT situations in test-based studies, as well.

The study is an attempt to bring traditional IR studies and realistic research settings closer to each other. Using authentic WTs when studying IR is still rare. The representativeness of the WT/ST types used in interactive IR experiments should be carefully addressed: in the work flow, people seldom consciously recognise separate “STs”. This means that STs may mainly be an academic construct even to the point that studying IR without a decent context does violence to the further understanding of the phenomenon.

This study explores the effects of cognitive load on the propensity to reformulate queries during information seeking on the web.

This study employs an experimental design to analyze the effect of manipulations of cognitive load on the propensity for query reformulation between experimental and control groups. In total, three affective components that contribute to cognitive load were manipulated: mental demand, temporal demand and frustration.

A significant difference in the propensity of query reformulation behavior was found between searchers exposed to cognitive load manipulations and searchers who were not exposed. Those exposed to cognitive load manipulations made half as many search query reformulations as searchers not exposed. Furthermore, the National Aeronautical and Space Administration Task Load Index (NASA-TLX) cognitive load scores of searchers who were exposed to the three cognitive load manipulations were higher than those of searchers who were not exposed indicating that the manipulation was effective. Query reformulation behavior did not differ across task types.

The findings suggest that a dual-task method and NASA-TLX assessment serve as good indicators of cognitive load. Because the findings show that cognitive load hinders a searcher's interaction with information search tools, this study provides empirical support for reducing cognitive load when designing information systems or user interfaces.

The purpose of the evaluation described in this paper is to determine the usability of the services provided by the EBSCOhost Mobile application.

The methodology employed was usability testing, comprising pre‐ and post‐usability test questionnaires and “think out‐loud” usability tests.

Recommendations are made concerning changes to the interface to ensure greater usability.

In this study, the only mobile device used in the testing of EBSCOhost Mobile was the iPhone 3GS. None of the participants had used or owned a smartphone previously.

Libraries are increasingly turning to the Mobile Web to offer new services to their patrons. Smartphones are likely to become central to the future delivery of information services.

Clustering web search results into dynamic clusters and hierarchies provides a promising way to alleviate the overabundance of information typically found in ranked list search engines. This study seeks to investigate the usefulness of clustering textual results in web search by analysing the search performance and users' satisfaction levels with and without the aid of clusters and hierarchies.

This study utilises two evaluation metrics. One is a usability test of clustering interfaces measured by users' search performances; the other is a comprehension test measured by users' satisfaction levels. Various methods were used to support the two tests, including experiments, observations, questionnaires, interviews, and search log analysis.

The results showed that there was no significant difference between the ranked list and clustering interfaces, although participants searched slightly faster, retrieved a larger number of relevant pages, and were more satisfied when using the ranked list interface without clustering. Even so, the clustering interface offers opportunities for diversified searching. Moreover, the repetitive ratio of relevant results found by each participant was low. Other advantages of the clustering interface are that it highlights important concepts and offers richer contexts for exploring, learning and discovering related concepts; however, it may induce a certain amount of anxiety about missing or losing important information.

The evaluation of a clustering interface is rather difficult, particularly in the context of the web search environment, which is used by a large heterogeneous user population for a wide variety of tasks. The study employed multiple data collection methods and in particular designed a combination of usability and comprehension tests to offer preliminary results on users' evaluation of real‐world clustering search interfaces. The results may extend the understanding of search characteristics with a cluster‐based web search engine, and could be used as a vehicle for further discussion of user evaluation research into this area.

Previous research has demonstrated that task is the driving force for information retrieval (IR). However, few studies investigate how people engaged in work and search tasks define their decisions and behaviors in the IR process. The purpose of this paper is to investigate how dimensions of tasks affect the information‐seeking and retrieving process.

In total, 40 participants are recruited for the two studies conducted in a corporate setting as well as an academic setting. Multiple methods are applied to collect data related to participants' tasks and the information‐seeking and retrieving process: web surveys, questionnaires, diaries, and telephone interviews. Both qualitative and quantitative data are analyzed.

This paper identifies nature (routine, typical, and unusual), stages (pre‐focus, formation, and post‐focus), and timeframe (extremely urgent, urgent, and non‐urgent) as dimensions of work tasks as well as origination (self‐generated and assigned), types (updating information, looking for specific information, looking for items with common characteristics, and looking for known items), and flexibility (very flexible, flexible, and inflexible) as dimensions of search tasks. Moreover, the relationships between dimensions of work and search tasks and the information‐seeking process – in particular, the extent of planning, the application of different types of information‐seeking strategies, and shifts in search‐task‐related goals – are explored.

This paper fills in a gap in current research – the impact of dimensions of task on the information‐seeking and ‐retrieving process.