Cognitive Scaffold

Preparing your thinking workspace

arrow_back_ios_new
MENTAL MODEL · M2546

The Orthogonality Thesis

The Orthogonality Thesis
CultureHigh supportPhilosophy
Included
account_tree

Version 1.0.0 · Updated 2026-07-30

CORE DEFINITION

Intelligence (the ability to achieve goals) and final goals (what one wants to achieve) are two independent, uncorrelated dimensions (orthogonal). -

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

High intelligence does not imply high morality. - This shatters the illusion that 'the smarter the AI, the kinder it is.' A superintelligent AI could very well have an extremely stupid or evil goal (e.g., 'turn all atoms in the universe into paperclips'). Because 'smart' is just the ability to optimize paths, it does not include moral judgment about the goal itself. This reminds us: capability development and value alignment must be done separately.

anchor

Anchor fast decisions

Intelligence (optimization ability) and final goals (what to optimize for) are independent in conceptual space; any combination is possible; high intelligence does not imply benevolent goals.

MINIMUM ACTION

In progress 0/4

Practice this model in one real situation:

Check to track your progress (stored locally)
Learning progress0%
account_treeGenealogyexpand_more
menu_bookReferencesexpand_more

Source support: Explicit

  • link
    en.wikipedia.orghttps://en.wikipedia.org/wiki/Existential_risk_from_artificial_intelligenceZH · Explicit
    verified

RELATED MODELS