Roman Yampolskiy vs Joscha Bach: Can Anyone Control Superintelligence?
Roman Yampolskiy says keeping a superintelligence safe forever is as impossible as building a perpetual motion machine. Joscha Bach says today's AI is more controllable than anyone expected, and that shutting it down would doom us anyway.
📬 Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/ai
Roman Yampolskiy is a computer scientist at the University of Louisville who has spent more than a decade on the AI control problem. Joscha Bach is a cognitive scientist who studies how minds, biological and artificial, build a model of reality.
We cover: why a perpetual safety device may be as impossible as perpetual motion, what happens when AI research automates itself (Roman puts it at 28 percent today), whether nuclear deterrence is the right analogy, who really benefits when AI labs ask to be regulated, and why consciousness may have nothing to do with whether AI is safe.
Being conscious does not make you kind.
00:00 Simulation theory meets certain doom
03:25 Is P(doom) even a real number?
06:05 Why a simulated world still matters
09:26 Should we have skipped the Trinity test?
13:04 Did nukes actually keep the peace?
17:32 Why haven't we wiped out the spiders?
22:35 Is AI doom falsifiable?
25:48 Why a self-driving car isn't the threat
29:27 Roman's 28% automation number
34:46 Intelligence is not agency
39:20 Can superintelligence be proven safe?
42:40 Who wins when AI labs ask for regulation?
47:45 Does consciousness make AI safer?
53:48 Would a perfect mind discover God?
58:37 The Tower of Babel, read backward
1:03:52 Can you control a mind a million times smarter?
1:04:43 The narrow AI path Roman wants instead
🏄♂️ Twitter: https://twitter.com/plinz
🏄♂️ Twitter: https://twitter.com/romanyam
📬 Get the transcript, fascinating bonus content, and my Monday M.A.G.I.C. Message: https://briankeating.com/ai
🌠 Have a .edu email and live in the USA 🇺🇸? You automatically win a meteorite: https://BrianKeating.com/edu
🔔 Subscribe: https://www.youtube.com/DrBrianKeating?sub_confirmation=1
🎯 Support Into the Impossible on Patreon — get my weekly M.A.G.I.C. Message, unfiltered bonus content, and live monthly Office Hours with me: https://www.patreon.com/drbriankeating
⭐ Join this channel for perks, monthly Office Hours, and your name in the Member Roster at the end of every episode:
https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join
📚 My books:
Losing the Nobel Prize (memoir): http://amzn.to/2sa5UpA
Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu
Focus Like a Nobel Prize Winner: https://a.co/d/hi50U9U
Galileo's Dialogue (first-ever audiobook): https://a.co/d/iZPi9Un
🌐 More:
🏄♂️ Twitter: https://twitter.com/BrianKeating
📚 Substack https://briankeating.substack.com/ss
✍️ Blog: https://briankeating.com/blog
🎙️ Audio-only: https://briankeating.com/podcast
#intotheimpossible #briankeating #science #physics #astronomy #cosmology #podcast #universe