Data processing using information theory functionals

Rallis C. Papademetriou (Department of Electrical and Electronic Engineering, University of Portsmouth, Portsmouth, UK)


ISSN: 0368-492X

Publication date: 1 April 1998


This paper presents an overview of three information‐theoretic methods, which have been used extensively in many areas such as signal/image processing, pattern recognition and statistical inference. These are: the maximum entropy (ME), minimum cross‐entropy (MCE) and mutual information (MI) methods. The development history of these techniques is reviewed, their essential philosophy is explained, and typical applications, supported by simulation results, are discussed.



Papademetriou, R. (1998), "Data processing using information theory functionals", Kybernetes, Vol. 27 No. 3, pp. 264-272.

Download as .RIS




Copyright © 1998, MCB UP Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.
To rent this content from Deepdyve, please click the button.