Employing an experimental approach to evaluate the impact of an intelligent agent

Bernard Mark Garrett (School of Nursing, Faculty of Applied Science, University of British Columbia, T201‐2211 Wesbrook Mall, Vancouver, B.C. V6T 2B5, Canada)

Interactive Technology and Smart Education

ISSN: 1741-5659

Publication date: 29 February 2004

Abstract

This paper explores a different approach to evaluating the merits of specific technical components of computer based learning applications. A traditional double blind experimental study was implemented in a new context. A computer based Clinical Decision Simulator (CDS) system was designed and implemented incorporating an intelligent agent. This was compared to an otherwise identical system with no agent, and a group of students not using CBL systems. The results suggested that although no improvement in measurable learning outcomes could be conclusively demonstrated there was some evidence that those students using the intelligent agent system demonstrated more positive learning experiences and a deeper conceptualisation of the issues. This would suggest that a comparative multimethod experimental evaluation strategy, although complex (and not without its shortcomings) may help provide a more comprehensive analysis of students learning experience, and provide a useful picture of the student’s perceptions of CBL tools. This novel approach may be of particular relevance where the justification of a specific technological aspect of an e‐learning application is required. The value of developing and using an experimental strategy to evaluate a specific technological aspect of a computer based learning (CBL) application is discussed.

Keywords

Citation

Garrett, B. (2004), "Employing an experimental approach to evaluate the impact of an intelligent agent", Interactive Technology and Smart Education, Vol. 1 No. 1, pp. 41-54. https://doi.org/10.1108/17415650480000011

Download as .RIS

Publisher

:

Emerald Group Publishing Limited

Copyright © 2004, Emerald Group Publishing Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.
To rent this content from Deepdyve, please click the button.