MENTAL MODEL · M7571

Information Theory

SystemsHigh supportSystems Theory

Included

Version 1.0.0 · Updated 2026-07-28

CORE DEFINITION

Information theory is the mathematical study of the quantification, storage, and communication of a particular type of mathematically defined information. The field was established and formalized by Claude Shannon in the 1940s, though early contributions were made in the 1920s through the works of Harry Nyquist and Ralph Hartley.

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

anchor

Anchor fast decisions

Shannon's information theory defines 'information' as the amount of uncertainty reduced (measured by entropy), and communication as encoding, transmission, and decoding to combat noise. The core idea: the value of information lies in its ability to reduce the receiver's uncertainty; it is independent of semantics, concerned only with probability and structure. From this derive concepts such as channel capacity, redundancy, and compression.

MINIMUM ACTION

In progress 0/1

Practice this model in one real situation:

When encountering an action or decision, first ask: 'Does it reduce uncertainty?' 2) If it is noise (does not reduce uncertainty), cut it out. 3) Use encoding/compression to remove redundancy, and use redundancy (checksums) to combat noise. 4) Reframe the problem as 'What type of uncertainty needs to be reduced?'

Check to track your progress (stored locally)

Learning progress0%

account_treeGenealogyexpand_more

menu_bookReferencesexpand_more

Source support: Explicit

link
en.wikipedia.orghttps://en.wikipedia.org/wiki/Information_theoryZH · Explicit
verified

RELATED MODELS