Five decades of information theory: successes, disappointments, prospects

Abstract

Surveys some of the important contributions of information theory (IT) to the understanding of systems science and cybernetics. Presents a short background on the main definitions of IT, and examines in which way IT could be thought of as a unified approach to general systems. Analyses the topics: syntax and semantics in information, information and self‐organization, entropy of forms (entropy of non‐random functions), and information in dynamical systems. Enumerates some suggestions for further research and takes this opportunity to describe new points of view, mainly by using entropy of non‐random functions.

Citation

Jumarie, G. (1996), "Five decades of information theory: successes, disappointments, prospects", Kybernetes, Vol. 25 No. 7/8, pp. 164-186. https://doi.org/10.1108/03684929610149756