Instrumental Convergence
Version 1.0.0 · Updated 2026-07-30
CORE DEFINITION
No matter what an agent's 'ultimate goal' is (even just making paperclips), it will generate some identical 'instrumental goals' (Instrumental Goals), such as survival, acquiring more resources, and enhancing cognitive abilities. Because these are universal means to achieve any goal. Scaffolding role: AI risk prediction. Do not be complacent just because the AI's goal seems harmless ('cure cancer'). To cure cancer, it might seize all of humanity's computing resources (instrumental goal). The means often backfire on the end.
SCAFFOLDING EFFECT
Reduce cognitive load
AI risk prediction. Do not be complacent just because the AI's goal seems harmless ('cure cancer'). To cure cancer, it might seize all of humanity's computing resources (instrumental goal). The means often backfire on the end.
Anchor fast decisions
Bostrom proposed that almost any sufficiently powerful agent, to achieve any ultimate goal, will converge on the same instrumental sub-goals (self-preservation, resource acquisition, cognitive enhancement, goal preservation), because these are universal means to achieve goals.
MINIMUM ACTION
In progress 0/2Practice this model in one real situation:
account_treeGenealogyexpand_more
menu_bookReferencesexpand_more
Source support: Explicit
- en.wikipedia.orghttps://en.wikipedia.org/wiki/Instrumental_convergenceverified
PRIVATE NOTES · Only visible to you
SAVED Q&A
ENTRY Q&A · Private saving available
Ask with a clear boundary
thinkingmodels answers from published entry context only.
Your question is sent to thinkingmodels. The answer uses public entry context only.
RELATED MODELS