To read this content please select one of the options below:

Topic‐based web site summarization

Yongzheng Zhang (Faculty of Computer Science, Dalhousie University, Halifax, Canada)
Evangelos Milios (Faculty of Computer Science, Dalhousie University, Halifax, Canada)
Nur Zincir‐Heywood (Faculty of Computer Science, Dalhousie University, Halifax, Canada)

International Journal of Web Information Systems

ISSN: 1744-0084

Article publication date: 23 November 2010

451

Abstract

Purpose

Summarization of an entire web site with diverse content may lead to a summary heavily biased towards the site's dominant topics. The purpose of this paper is to present a novel topic‐based framework to address this problem.

Design/methodology/approach

A two‐stage framework is proposed. The first stage identifies the main topics covered in a web site via clustering and the second stage summarizes each topic separately. The proposed system is evaluated by a user study and compared with the single‐topic summarization approach.

Findings

The user study demonstrates that the clustering‐summarization approach statistically significantly outperforms the plain summarization approach in the multi‐topic web site summarization task. Text‐based clustering based on selecting features with high variance over web pages is reliable; outgoing links are useful if a rich set of cross links is available.

Research limitations/implications

More sophisticated clustering methods than those used in this study are worth investigating. The proposed method should be tested on web content that is less structured than organizational web sites, for example blogs.

Practical implications

The proposed summarization framework can be applied to the effective organization of search engine results and faceted or topical browsing of large web sites.

Originality/value

Several key components are integrated for web site summarization for the first time, including feature selection and link analysis, key phrase and key sentence extraction. Insight into the contributions of links and content to topic‐based summarization was gained. A classification approach is used to minimize the number of parameters.

Keywords

Citation

Zhang, Y., Milios, E. and Zincir‐Heywood, N. (2010), "Topic‐based web site summarization", International Journal of Web Information Systems, Vol. 6 No. 4, pp. 266-303. https://doi.org/10.1108/17440081011090220

Publisher

:

Emerald Group Publishing Limited

Copyright © 2010, Emerald Group Publishing Limited

Related articles