Towards a semantics representation framework for narrative images

Xuhui Li (School of Information Management, Wuhan University, Wuhan, Hubei, China)
Yanqiu Wu (School of Information Management, Wuhan University, Wuhan, Hubei, China)
Xiaoguang Wang (School of Information Management, Wuhan University, Wuhan, Hubei, China)
Tieyun Qian (School of Computer Science, Wuhan University, Wuhan, Hubei, China)
Liang Hong (Shenzhen Research Institute, Wuhan University, Shenzhen, Guangdong, China)

The Electronic Library

ISSN: 0264-0473

Publication date: 10 May 2019



The purpose of this paper is to explore a semantics representation framework for narrative images, conforming to the image-interpretation process.


This paper explores the essential features of semantics evolution in the process of narrative images interpretation. It proposes a novel semantics representation framework, ESImage (evolution semantics of image) for narrative images. ESImage adopts a hierarchical architecture to progressively organize the semantic information in images, enabling the evolutionary interpretation under the support of a graph-based semantics data model. Also, the study shows the feasibility of this framework by addressing the issues of typical semantics representation with the scenario of the Dunhuang fresco.


The process of image interpretation mainly concerns three issues: bottom-up description, the multi-faceted semantics representation and the top-down semantics complementation. ESImage can provide a comprehensive solution for narrative image semantics representation by addressing the major issues based on the semantics evolution mechanisms of the graph-based semantics data model.

Research limitations/implications

ESImage needs to be combined with machine learning to meet the requirements of automatic annotation and semantics interpretation of large-scale image resources.


This paper sorts out the characteristics of the gradual interpretation of narrative images and has discussed the major issues in its semantics representation. Also, it proposes the semantic framework ESImage which deploys a flexible and sound mechanism to represent the semantic information of narrative images.



Xuhui Li, Yanqiu Wu, Xiaoguang Wang, Tieyun Qian and Liang Hong (2019) "Towards a semantics representation framework for narrative images", The Electronic Library , Vol. ahead-of-print No. ahead-of-print

Download as .RIS





Emerald Publishing Limited

Copyright © 2019, Emerald Publishing Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.