Using the Web Graph to influence application behaviour

Michael P. Evans (Lecturer, Applied Informatics and Semiotics Laboratory, University of Reading, Reading, UK)
Andrew Walker (Research Student, School of Mathematics, Kingston University, Kingston‐upon‐Thames, UK)

Internet Research

ISSN: 1066-2243

Publication date: 1 December 2004

Abstract

The Web's link structure (termed the Web Graph) is a richly connected set of Web pages. Current applications use this graph for indexing and information retrieval purposes. In contrast the relationship between Web Graph and application is reversed by letting the structure of the Web Graph influence the behaviour of an application. Presents a novel Web crawling agent, AlienBot, the output of which is orthogonally coupled to the enemy generation strategy of a computer game. The Web Graph guides AlienBot, causing it to generate a stochastic process. Shows the effectiveness of such unorthodox coupling to both the playability of the game and the heuristics of the Web crawler. In addition, presents the results of the sample of Web pages collected by the crawling process. In particular, shows: how AlienBot was able to identify the power law inherent in the link structure of the Web; that 61.74 per cent of Web pages use some form of scripting technology; that the size of the Web can be estimated at just over 5.2 billion pages; and that less than 7 per cent of Web pages fully comply with some variant of (X)HTML.

Keywords

Citation

Evans, M. and Walker, A. (2004), "Using the Web Graph to influence application behaviour", Internet Research, Vol. 14 No. 5, pp. 372-378. https://doi.org/10.1108/10662240410566971

Download as .RIS

Publisher

:

Emerald Group Publishing Limited

Copyright © 2004, Emerald Group Publishing Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.
To rent this content from Deepdyve, please click the button.