One core element of interactive information retrieval (IIR) experiments is the assignment of search tasks. The purpose of this paper is to provide an analytical review of current practice in developing those search tasks to test, observe or control task complexity and difficulty.
Over 100 prior studies of IIR were examined in terms of how each defined task complexity and/or difficulty (or related concepts) and subsequently interpreted those concepts in the development of the assigned search tasks.
Search task complexity is found to include three dimensions: multiplicity of subtasks or steps, multiplicity of facets, and indeterminability. Search task difficulty is based on an interaction between the search task and the attributes of the searcher or the attributes of the search situation. The paper highlights the anomalies in our use of these two concepts, concluding with suggestions for future methodological research related to search task complexity and difficulty.
By analyzing and synthesizing current practices, this paper provides guidance for future experiments in IIR that involve these two constructs.
This research is partially supported by a grant to the second author from the NGAIA project of the GRAND Network of Centres of Excellence, Canada. Financial and technical support has also been received from the School of Information & Library Science, University of North Carolina at Chapel Hill.
Wildemuth, B., Freund, L. and G. Toms, E. (2014), "Untangling search task complexity and difficulty in the context of interactive information retrieval studies", Journal of Documentation, Vol. 70 No. 6, pp. 1118-1140. https://doi.org/10.1108/JD-03-2014-0056
Emerald Group Publishing Limited
Copyright © 2014, Emerald Group Publishing Limited