Roman Yampolskiy: Dangers of Superintelligent AI | Lex Fridman Podcast #431

I think that before we reach superinteligent AGI we'll reach a more darker and oppressive state of technofeudalism that can be best summarized by this amazing quote from the first Dune book: “Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.”

I think Lex gives too much credit to humanity

Lex: *"What gives you hope"* Roman: *"That I might be wrong. I could be. I've been wrong before".*

Lex: "On a more mundane note, how do you spend your weekends?" Roman: "I have a paper about that"

Who else is here after seeing Roman's Rogan appearance?

Ive been a first responder for the last few decades. One of the rules of my profession, especially when dealing with life and death, is to expect and always be prepared for the worst case scenerio and mitigate risks as much as possible. This man understands that concept. I love Lex's optimism, but in some situations optimism can be very, very dangerous

“What gives you hope?” “ I could be wrong” lol

Here are the timestamps. Please check out our sponsors to support this podcast. 0:00 - Introduction & sponsor mentions: - Yahoo Finance: https://yahoofinance.com - MasterClass: https://masterclass.com/lexpod to get 15% off - NetSuite: http://netsuite.com/lex to get free product tour - LMNT: https://drinkLMNT.com/lex to get free sample pack - Eight Sleep: https://eightsleep.com/lex to get $350 off 2:20 - Existential risk of AGI 8:32 - Ikigai risk 16:44 - Suffering risk 20:19 - Timeline to AGI 24:51 - AGI turing test 30:14 - Yann LeCun and open source AI 43:06 - AI control 45:33 - Social engineering 48:06 - Fearmongering 57:57 - AI deception 1:04:30 - Verification 1:11:29 - Self-improving AI 1:23:42 - Pausing AI development 1:29:59 - AI Safety 1:39:43 - Current AI 1:45:05 - Simulation 1:52:24 - Aliens 1:53:57 - Human mind 2:00:17 - Neuralink 2:09:23 - Hope for the future 2:13:18 - Meaning of life

this interview is like a situation where a father must explain his spoiled kid, that the fireworks can't be deployed in the living room.

This is what disagreements look like in a perfect world, I wish all differences of opinion were so calmly discussed