Cognitive Scaffold

Preparing your thinking workspace

arrow_back_ios_new
MENTAL MODEL · M10447

Conditional Entropy

Conditional Entropy
TechnicalHigh supportStatistics
Included
account_tree

Version 1.0.0 · Updated 2026-07-30

CORE DEFINITION

Given the knowledge of one variable, the remaining uncertainty of another variable—how much uncertainty is reduced by the condition?

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

The value of information. The value of a piece of information is reflected in how much uncertainty it reduces.

anchor

Anchor fast decisions

The uncertainty of X given a known random variable Y, H(X|Y), measures 'how much uncertainty about X can be eliminated by Y'.

MINIMUM ACTION

In progress 0/2

Practice this model in one real situation:

Check to track your progress (stored locally)
Learning progress0%
account_treeGenealogyexpand_more
menu_bookReferencesexpand_more

Source support: Explicit

  • link
    zh.wikipedia.orghttps://zh.wikipedia.org/wiki/%E6%9D%A1%E4%BB%B6%E7%86%B5ZH · Explicit
    verified

RELATED MODELS

Related model

German Tank Problem

Estimate an unknown population upper bound from a random sample of sequential identifiers without replacement.

arrow_forwardRelated model

Berkson's Paradox

Berkson's paradox, also known as Berkson's bias, collider bias, or Berkson's fallacy, refers to the situation where people's intuitive observations do not match the actual conditional probabilities and rigorous statistical results; that is, the seemingly correlated factors that people discover are actually unrelated. This occurs when biased samples are included in the study design and bias exists. The paradox was proposed by American physician and statistician Joseph Berkson in 1946.

arrow_forwardRelated model

Green Lumber Fallacy

Focusing on trivial details while ignoring key elements.

arrow_forward