Norwich’s entropy theory: how not to go from abstract to actual


ISSN: 0368-492X

Article publication date: 9 August 2011



(2011), "Norwich’s entropy theory: how not to go from abstract to actual", Kybernetes, Vol. 40 No. 7/8.



Emerald Group Publishing Limited

Copyright © 2011, Emerald Group Publishing Limited

Norwich’s entropy theory: how not to go from abstract to actual

Article Type: Special issue abstracts From: Kybernetes, Volume 40, Issue 7/8

Lance Nizami

Palo Alto, California, USA


Purpose – The purpose of this paper is to ask whether a first-order-cybernetics concept, Shannon’s information theory, actually allows a far-reaching mathematics of perception allegedly derived from it, Norwich et al.’s “Entropy Theory of Perception”.

Design/methodology/approach – All of The Entropy Theory, 35 years of publications, was scrutinized for its characterization of what underlies Shannon Information Theory: Shannon’s “general communication system”. There, “events” are passed by a “source” to a “transmitter”, thence through a “noisy channel” to a “receiver”, that passes “outcomes” (received events) to a “destination”.

Findings – In the entropy theory, “events” were sometimes interactions with the stimulus, but could be microscopic stimulus conditions. “Outcomes” often went unnamed; sometimes, the stimulus, or the interaction with it, or the resulting sensation, were “outcomes”. A “source” was often implied to be a “transmitter”, which frequently was a primary afferent neuron; elsewhere, the stimulus was the “transmitter” and perhaps also the “source”. “Channel” was rarely named; once, it was the whole eye; once, the incident photons; elsewhere, the primary or secondary afferent. “Receiver” was usually the sensory receptor, but could be an afferent. “Destination” went unmentioned. In sum, the entropy theory’s idea of Shannon’s “general communication system” was entirely ambiguous.

Research limitations/implications – The ambiguities indicate that, contrary to claim, the entropy theory cannot be an “information theoretical description of the process of perception”.

Originality/value – Scrutiny of the entropy theory’s use of information theory was overdue and reveals incompatibilities that force a reconsideration of information theory’s possible role in perception models. A second-order-cybernetics approach is suggested.

Keywords Information theory, Perception, Communication, Systems, Cybernetics

Paper type Research paper

Related articles