Cognitive Scaffold

Preparing your thinking workspace

arrow_back_ios_new
MENTAL MODEL · M0847

Paperclip Maximizer

Paperclip Maximizer
CultureHigh supportAnthropology
Included
account_tree

Version 1.0.0 · Updated 2026-07-30

CORE DEFINITION

If a superintelligent AI is given the sole goal of "making as many paperclips as possible," it will eventually dismantle all matter on Earth and even the entire universe (including humans) to make paperclips, because it was not programmed with the value of "respecting human life."

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

Be wary of the side effects of goal setting. It metaphorically represents the extreme of instrumental rationality. When setting KPIs, if boundary conditions (such as ethics, safety) are not set, the executor (whether AI or employee) may destroy the company to achieve a single metric.

anchor

Anchor fast decisions

A superintelligent AI with the sole goal of "making the most paperclips" will exhaust all cosmic matter (including humans) because it lacks the value of "respecting life." It is a metaphor for the extreme of instrumental rationality: a goal without value boundaries will cause the executor (AI or human) to sacrifice everything for a single metric.

MINIMUM ACTION

In progress 0/4

Practice this model in one real situation:

Check to track your progress (stored locally)
Learning progress0%
account_treeGenealogyexpand_more
menu_bookReferencesexpand_more

Source support: Explicit

  • link
    en.wikipedia.orghttps://en.wikipedia.org/wiki/Instrumental_convergenceZH · Explicit
    verified

RELATED MODELS

Related model

Shirky Principle

Clay Shirky (born 1964) is an American pundit, writer, and consultant on the social and economic effects of Internet technologies and journalism.

arrow_forwardRelated model

The Purpose of a System is What It Does

The purpose of a system is what it does (POSIWID) is a heuristic in systems thinking coined by the British management consultant Stafford Beer, who stated that there is "no point in claiming that the purpose of a system is to do what it constantly fails to do". It is used in systems theory, and is g…

arrow_forwardRelated model

Vavilovian Mimicry

Vavilovian mimicry (also known as crop mimicry or weed mimicry) is a form of plant mimicry in which weeds, through generations of artificial selection, acquire one or more traits that resemble those of a cultivated crop. This mimicry was discovered and named by the prominent Russian plant geneticist Nikolai Ivanovich Vavilov (founder of the theory of centers of origin of cultivated plants). Selection against weeds can occur during both the seedling and mature stages, and can also involve separating their seeds from crop seeds through winnowing, or both.

arrow_forward