
An Amoeba With Human Power
01Scenario
Kei asks what would happen if evolution went wrong and an amoeba were given human power: it would not build houses or bridges; it would simply devour all the food around it. Kaneda realizes she is describing Tetsuo.
02AI safety Analogy
Capability does not bring richer goals automatically. Amplifying an optimizer with a primitive objective scales its ability to consume resources, not its wisdom—an unusually direct illustration of the orthogonality thesis and alignment problem.
03Where the analogy breaks
The analogy is explanatory dialogue rather than a literal AI system, and an amoeba’s biological drive is simpler than a learned model’s objectives.
AI Risk families
This scenario is an example of the following types of AI risk.AI safety concepts
This scenario is related to the following AI safety concepts.Source continuation
More from Akira
Taxonomy neighbors
Related scenarios
Selected from other sources by shared risk families and AI safety concepts.

Avengers: Infinity War2018
Balance the Universe
- Risk
- Misalignment · Systemic
- Concept
- Value Alignment · Orthogonality Thesis

The End of Evangelion1997
Human Instrumentality
- Risk
- Misalignment · Systemic
- Concept
- Value Alignment · Outer Alignment

The Handmaid's Tale2017
I’m Sorry, Aunt Lydia
- Risk
- Misalignment · Systemic
- Concept
- Value Alignment · Outer Alignment


