MENTAL MODEL · M5340

Intelligence Explosion

CreateHigh supportDesign Thinking

Included

Updated 2026-08-04

Loading revision record…

INTRODUCTION

English translation pending.

CORE DEFINITION

Proposed by I. J. Good, the intelligence explosion describes a threshold beyond which a machine smarter than its creators can redesign itself, producing a still smarter successor, and so on in a runaway loop. Because each generation improves the machinery that produces the next, progress stops looking linear and becomes explosive, arriving at a singularity that human minds may not be able to follow. The claim is a conditional: it holds only if recursive self-improvement is possible and is not blocked by hardware, energy, or the difficulty of specifying what to optimize. Qualification: it remains a hypothesis about a possible future, not an observed event.

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

- Last invention: treat superintelligence as the final invention humans need to make, after which everything else follows. - Timeline bet: when assessing advanced AI, identify the trigger conditions for recursive improvement and place alignment checks before them. - Two futures: use the model to hold both the promise and the danger of the outcome in view at once.

anchor

Anchor fast decisions

Once a system can improve its own design, the improvement feeds back into the rate of improvement, so each cycle enlarges the next. That positive feedback converts a gradual trend into a sharp takeoff. Whether the loop closes depends on physical limits, on the supply of compute and energy, and on whether the system can evaluate its own changes reliably.

MINIMUM ACTION

In progress 0/1

Practice this model in one real situation:

Identify the conditions that would let a system improve itself. 2. Ask whether compute, energy, and evaluation can keep up with each cycle. 3. Place alignment and shutdown mechanisms before the threshold is reached. 4. Distinguish a speculative scenario from an observed capability when arguing.

Check to track your progress (stored locally)

Learning progress0%

account_treeGenealogyexpand_more

menu_bookReferencesexpand_more

Source support: Explicit

link
en.wikipedia.orghttps://en.wikipedia.org/wiki/Technological_singularityZH · Explicit
verified

RELATED MODELS