Cognitive Scaffold

Preparing your thinking workspace

arrow_back_ios_new
MENTAL MODEL · M2230

Kullback-Leibler Divergence

Kullback-Leibler Divergence
Learn & MetacognitionHigh supportCognitive Science
Included
account_tree

Version 1.0.0 · Updated 2026-07-30

CORE DEFINITION

A metric used to measure the difference between two probability distributions (e.g., 'your beliefs' and 'the real world'). The larger the KL divergence, the more your model deviates from reality, and the more 'information' you need to correct it. - Scaffolding role: A measure of cognitive surprise. - The essence of learning is to minimize KL divergence. When you encounter something that makes you 'extremely surprised' (KL divergence spikes), that is the best moment for cognitive upgrade. Do not ignore surprise; surprise means your internal model is severely inconsistent with the external world, which is a golden opportunity to correct cognition.

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

A measure of cognitive surprise. - The essence of learning is to minimize KL divergence. When you encounter something that makes you 'extremely surprised' (KL divergence spikes), that is the best moment for cognitive upgrade. Do not ignore surprise; surprise means your internal model is severely inconsistent with the external world, which is a golden opportunity to correct cognition.

anchor

Anchor fast decisions

A metric for measuring the difference between two probability distributions (relative entropy). The larger the KL divergence, the more the model deviates from reality, and the more information is needed to correct it. The mechanism can be extended as a measure of cognitive surprise—the essence of learning is to minimize KL divergence; when encountering something extremely surprising (KL spikes), it indicates a severe mismatch between the internal model and the external world, presenting a golden opportunity to correct cognition.

MINIMUM ACTION

In progress 0/4

Practice this model in one real situation:

Check to track your progress (stored locally)
Learning progress0%
account_treeGenealogyexpand_more
menu_bookReferencesexpand_more

Source support: Explicit

  • link
    zh.wikipedia.orghttps://zh.wikipedia.org/wiki/%E7%9B%B8%E5%AF%B9%E7%86%B5ZH · Explicit
    verified

RELATED MODELS

Related model

Catastrophic Forgetting

Catastrophic interference, also known as catastrophic forgetting, is the tendency of an artificial neural network to abruptly and drastically forget previously learned information upon learning new information.

arrow_forwardRelated model

Exploding Head Syndrome

A sleep-related experience of a sudden perceived loud noise around sleep onset or awakening, usually without pain.

arrow_forwardRelated model

Unknown Unknowns

Knowledge gaps or uncertainties not yet recognized as such; the terminology predates Rumsfeld’s prominent 2002 remarks.

arrow_forward