To read the full version of this content please select one of the options below:

Discovery of concept entities from web sites using web unit mining

Ming Yin Ming (Division of Information Studies, School of Communication & Information, Nanyang Technological University, Singapore 639798)
Dion Hoe‐lian Goh (Division of Information Studies, School of Communication & Information, Nanyang Technological University, Singapore 639798)
Ee‐Peng Lim (Centre for Advanced Information Systems, School of Computer Engineering, Nanyang Technological University, Singapore 639798)
Aixin Sun (School of Computer Science and Engineering, University of New South Wales, Sydney, NSW, Australia 2052)

International Journal of Web Information Systems

ISSN: 1744-0084

Article publication date: 1 August 2005

Abstract

A web site usually contains a large number of concept entities, each consisting of one or more web pages connected by hyperlinks. In order to discover these concept entities for more expressive web site queries and other applications, the web unit mining problem has been proposed. Web unit mining aims to determine web pages that constitute a concept entity and classify concept entities into categories. Nevertheless, the performance of an existing web unit mining algorithm, iWUM, suffers as it may create more than one web unit (incomplete web units) from a single concept entity. This paper presents two methods to solve this problem. The first method introduces a more effective web fragment construction method so as reduce later classification errors. The second method incorporates site‐specific knowledge to discover and handle incomplete web units. Experiments show that incomplete web units can be removed and overall accuracy has been significantly improved, especially on the precision and F1 measures.

Keywords

Citation

Yin Ming, M., Hoe‐lian Goh, D., Lim, E. and Sun, A. (2005), "Discovery of concept entities from web sites using web unit mining", International Journal of Web Information Systems, Vol. 1 No. 3, pp. 123-136. https://doi.org/10.1108/17440080580000088

Publisher

:

Emerald Group Publishing Limited

Copyright © 2005, Emerald Group Publishing Limited