Data processing using information theory functionals
Rallis C. Papademetriou
(Department of Electrical and Electronic Engineering, University of Portsmouth, Portsmouth, UK)
754
Abstract
This paper presents an overview of three information‐theoretic methods, which have been used extensively in many areas such as signal/image processing, pattern recognition and statistical inference. These are: the maximum entropy (ME), minimum cross‐entropy (MCE) and mutual information (MI) methods. The development history of these techniques is reviewed, their essential philosophy is explained, and typical applications, supported by simulation results, are discussed.
Keywords
Citation
Papademetriou, R.C. (1998), "Data processing using information theory functionals", Kybernetes, Vol. 27 No. 3, pp. 264-272. https://doi.org/10.1108/03684929810209478
Publisher
:MCB UP Ltd
Copyright © 1998, MCB UP Limited