To read the full version of this content please select one of the options below:

Event‐based knowledge extraction from free‐text descriptions for art images by using semantic role labeling approaches

Chia‐Hung Lin (Department of Computer Science and Information Engineering, National ChiNan University, Puli, Taiwan)
Chia‐Wei Yen (Department of Computer Science and Information Engineering, National ChiNan University, Puli, Taiwan)
Jen‐Shin Hong (Department of Computer Science and Information Engineering, National ChiNan University, Puli, Taiwan)
Samuel Cruz‐Lara (Department of Computer Science, University of Nancy, Nancy, France)

The Electronic Library

ISSN: 0264-0473

Article publication date: 11 April 2008

Abstract

Purpose

The purpose of this paper is to show how previous studies have demonstrated that non‐professional users prefer using event‐based conceptual descriptions, such as “a woman wearing a hat”, to describe and search images. In many art image archives, these conceptual descriptions are manually annotated in free‐text fields. This study aims to explore technologies to automate event‐based knowledge extractions from these free‐text image descriptions.

Design/methodology/approach

This study presents an approach based on semantic role labeling technologies for automatically extracting event‐based knowledge, including subject, verb, object, location and temporal information from free‐text image descriptions. A query expansion module is applied to further improve the retrieval recall. The effectiveness of the proposed approach is evaluated by measuring the retrieval precision and recall capabilities for experiments with real life art image collections in museums.

Findings

Evaluations results indicate that the proposed method can achieve a substantially higher retrieval precision than conventional keyword‐based approaches. The proposed methodology is highly applicable for large‐scale collections where the image retrieval precision is more critical than the recall.

Originality/value

The study provides the first attempt in literature for automating the extraction of event‐based knowledge from free‐text image descriptions. The effectiveness and ease of implementation of the proposed approach make it feasible for practical applications.

Keywords

Citation

Lin, C., Yen, C., Hong, J. and Cruz‐Lara, S. (2008), "Event‐based knowledge extraction from free‐text descriptions for art images by using semantic role labeling approaches", The Electronic Library, Vol. 26 No. 2, pp. 215-225. https://doi.org/10.1108/02640470810864109

Publisher

:

Emerald Group Publishing Limited

Copyright © 2008, Emerald Group Publishing Limited