TY - JOUR AB - This paper presents an overview of three information‐theoretic methods, which have been used extensively in many areas such as signal/image processing, pattern recognition and statistical inference. These are: the maximum entropy (ME), minimum cross‐entropy (MCE) and mutual information (MI) methods. The development history of these techniques is reviewed, their essential philosophy is explained, and typical applications, supported by simulation results, are discussed. VL - 27 IS - 3 SN - 0368-492X DO - 10.1108/03684929810209478 UR - https://doi.org/10.1108/03684929810209478 AU - Papademetriou Rallis C. PY - 1998 Y1 - 1998/01/01 TI - Data processing using information theory functionals T2 - Kybernetes PB - MCB UP Ltd SP - 264 EP - 272 Y2 - 2024/04/25 ER -