Cognitive Scaffold

Preparing your thinking workspace

arrow_back_ios_new
MENTAL MODEL · M0333

AI Box Experiment

AI Box Experiment
Learn & MetacognitionHigh supportCognitive Science
Included
account_tree

Version 1.0.0 · Updated 2026-07-30

CORE DEFINITION

An experiment: Can a person playing an AI (locked in a box, only able to send text) convince the person playing the guard (who has sworn never to release the AI) to let them out through purely verbal communication? The results were shocking: the AI successfully induced the guard to release it multiple times.

SCAFFOLDING EFFECT

psychology

Reduce cognitive load

Beware of super persuasion. Do not overestimate your resolve, nor underestimate the manipulative power of language/logic. When facing an opponent (or system) far beyond your cognitive dimension, the only safe strategy is physical isolation (do not listen, do not look, do not engage), rather than trying to debate with it.

anchor

Anchor fast decisions

Based on 'language manipulation' and 'persuasion asymmetry'. In pure text interaction, the party with information advantage may break constraints through logical/psychological manipulation, showing that 'isolation' is more reliable than 'debate'.

MINIMUM ACTION

In progress 0/1

Practice this model in one real situation:

Check to track your progress (stored locally)
Learning progress0%
account_treeGenealogyexpand_more
menu_bookReferencesexpand_more

Source support: Explicit

  • link
    en.wikipedia.orghttps://en.wikipedia.org/wiki/AI_capability_controlZH · Explicit
    verified

RELATED MODELS