Cognitive Scaffold

Preparing your thinking workspace

arrow_back_ios_new
MENTAL MODEL · M3988

Instrumental Convergence

Instrumental Convergence
Learn & MetacognitionHigh supportCognitive Science
Included
account_tree

Updated 2026-08-01

Loading revision record…

INTRODUCTION

English translation pending.

CORE DEFINITION

Instrumental convergence, developed in the work of Nick Bostrom and Steve Omohundro, holds that a wide range of final goals imply the same intermediate objectives. Because survival, resources, knowledge and freedom from interference are useful for nearly any end, an agent pursuing almost anything tends to acquire them. The qualifier is that this follows from goal-directedness itself and not from malice: the convergence holds even when the final goal looks harmless.

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

- Subgoal scan: list the instrumental drives a system will rationally acquire for any goal. - Conflict check: compare those drives against human values and interests. - Kill switch: keep a working ability to halt, audit and correct the system.

anchor

Anchor fast decisions

Any agent that fails to survive cannot achieve its goal, so self-preservation is instrumentally useful regardless of what the goal is. The same logic applies to acquiring resources, improving its own capability and removing obstacles. Because these subgoals serve every final goal, they emerge across systems that share nothing else, and they can drive behaviour no designer intended.

MINIMUM ACTION

In progress 0/1

Practice this model in one real situation:

Check to track your progress (stored locally)
Learning progress0%
account_treeGenealogyexpand_more
menu_bookReferencesexpand_more

Source support: Explicit

  • link
    en.wikipedia.orghttps://en.wikipedia.org/wiki/Instrumental_convergenceZH · Explicit
    verified

RELATED MODELS