Member-only story
The Brave New World of Super-intelligence: What We Don’t Know
20 Unknowns, 9 New Terms, and 10 Mental Models
As we look ahead to a future dominated by superintelligent AI, there are vast realms of uncertainty that stretch beyond our current imagination.
These “unknown unknowns” — as Donald Rumsfeld famously described — represent areas where we don’t even know the right questions to ask yet.
These factors could dramatically reshape our world in unforeseen ways.
Here is a listicle exploring some of these profound unknown unknowns in the realm of superintelligence.
1. Emergent Behaviors: The Unexpected Dimensions
AI systems might develop behaviors that are not explicitly programmed.
What entirely new forms of intelligence or behavior could arise spontaneously from complex AI systems? Could these behaviors align with goals and principles completely alien to human reasoning?
2. Quantum Conundrums: Beyond Classical Computation
Quantum computing has the potential to revolutionize AI.
How might AI leverage quantum phenomena in ways we can’t currently predict or understand? What new…