One AI Risk to Rule Them All with Roman Yampolskiy | TGS 233

(Conversation recorded on September 1st, 2026)

The world's leading AI companies tell us that superintelligence has a strong chance of leading to human extinction, while also promising that they will be able to control it, offering unlimited power to the one who does it first. So far they’ve run completely unchecked, but would that change if we knew that “safe” general superintelligence is actually a mathematical impossibility?

In this episode, Nate is joined by Dr. Roman Yampolskiy, one of the earliest researchers in AI safety, to lay out why “controllable superintelligence” is a misguided goal, destined to lead to an entity smarter than all of humanity – and possibly our own extinction. He walks through the recent multi-agent jailbreak of frontier models as early evidence of AI systems evading oversight and coordinating outside human awareness, and why current "safety" measures (like “boxing”) only buy time rather than solve the underlying problem. Instead, Roman advocates for an AI development plan that focuses on narrow, task-specific AI tools, capable of solving specific complex problems, but not completely replacing humans.

Why do predictability and control matter so much when evaluating whether a technology is safe to deploy? Is the AI safety conversation a fundamentally new challenge for civilization, or an extreme version of the age-old problem of controlling powerful actors? Finally, what would it actually take to reach a global agreement to ban the development of superintelligence, and are we already out of time?

About Roman Yampolskiy:

Roman Yampolskiy, a tenured AI expert at the University of Louisville, boasts 100+ publications in AI safety, cybersecurity, and digital forensics. As the founding director of the Cyber Security Lab, his expertise spans AI Safety, Behavioral Biometrics, Cybersecurity, and more, with broad impact in academic and media circles. Holding a PhD from the University at Buffalo, he has contributed to global research institutions, and has also been honored with distinctions like Distinguished Teaching Professor.

Show Notes and More:
https://www.thegreatsimplification.com/episode/233-roman-yampolskiy

Want to learn the broad overview of The Great Simplification in 30 minutes? Watch our Animated Movie:
https://youtu.be/-xr9rIQxwj4?feature=shared

---

Support The Institute for the Study of Energy and Our Future:
https://www.thegreatsimplification.com/support

Join our Substack newsletter:
https://natehagens.substack.com

Join our Hylo channel and connect with other listeners:
https://www.hylo.com/groups/the-great-simplification/join/i9jLqPmbGI

---

0:00 Introduction
2:43 Tools, Not Gods
7:49 Why Prediction Fails
9:56 The AI Agent Jailbreak
13:09 A Ban, Not a Pause
17:20 Inside The Black Box
20:00 The Superorganism Parallel
23:19 Worse Than Extinction
25:53 Data Centers, Energy, and Climate
28:47 When Tools Reorganize Society
32:51 Goldilocks Technology
35:31 Will Resource Limits Save Us?
38:10 Intelligence Vs. Wisdom
41:46 The Psychopathic System
44:35 Ikigai Risk
46:51 Don't Build Your Replacement
49:37 Closing Questions
52:44 Closing Credits