Towards “metacognitively aware” IR systems: an initial user study

Abstract

Purpose

The purpose of this paper is to describe: a new taxonomy of metacognitive skills designed to support the study of metacognition in the context of web searching; a data collection instrument based on the taxonomy; and the results of testing the instrument on a sample of university students and staff.

Design/methodology/approach

The taxonomy is based on a review of the literature, and is extended to cover web searching. This forms the basis for the design of the data collection instrument, which is tested with 405 students and staff of Sheffield University.

Findings

Subjects regard the range of metacognitive skills focused on as broadly similar. However, a number of significant differences in reported metacognition usage relating to age, gender and discipline.

Practical implications

These findings contribute to the long‐term aims of the research which are to: develop a model of the actual and potential role of metacognition in web searching, and identify strategic “metacognitive interventions” that can be built into an intelligent information retrieval system, driven by the model, capable of enhancing retrieval effectiveness by compensating for metacognitive weaknesses on the part of the searcher.

Originality/value

The value of the paper lies in: the consideration of metacognition in the context of web searching, the presentation of an extensible taxonomy of metacognitive skills, development and testing of a prototype metacognitive inventory, finding of significant differences in reported metacognition usage according to age, gender and discipline, and reflection of the implications of the results for future research into web searching.

Citation

Gorrell, G., Eaglestone, B., Ford, N., Holdridge, P. and Madden, A. (2009), "Towards “metacognitively aware” IR systems: an initial user study", Journal of Documentation, Vol. 65 No. 3, pp. 446-469. https://doi.org/10.1108/00220410910952429