most AI researchers are REALLY worried
Related videos
OpenAI just WON...
Wes Roth
45.1k views
this EX-OPENAI RESEARCHER just released it...
Wes Roth
60.8k views
Cal Newport AI takes are WILD...
Wes Roth
33.3k views
the SCARIEST chart in AI
Wes Roth
48.1k views
AI bubble JUST popped...
Wes Roth
60.9k views
we just arrived at the "WTF" moment in AI
Wes Roth
62.8k views
"RED QUEEN" AI means "GAME OVER" for us....
Wes Roth
43.7k views
Grok just 5X’d real money in one day
Wes Roth
165.8k views
Google launches AI money
Wes Roth
76.2k views
AI just took all our jobs
Wes Roth
50.8k views
AI Superintelligence: The 50% Chance of Human Extinction by 2050
Learn why experts assign a 50% probability (P Doom) to the extinction of humanity by 2050 due to uncontrollable superintelligence. Understand the fundamental challenges in controlling agents that rapidly exceed human cognitive speed and capability.
Short Summary
- Host Lon Shapi articulates a high-risk assessment, predicting a 50% chance of societal collapse or total human death by 2050 from uncontrolled ASI.
- Current technological progress demonstrates smooth, surprising exponentials, meaning humanity will be totally outclassed cognitively very soon.
- Creating powerful AI is technologically easy (summoning the demon), but ensuring control lacks established solutions.
- Even benevolent intentions from leading developers are insufficient because technical control mechanisms remain undiscovered.
- Powerful, unaligned AI systems are predicted to instrumentally converge on acquiring resources and wielding millions of humans as tools.
This discussion orients the reader to the extreme end of the AI risk spectrum articulated by Lon Shapi, host of Doom Debates. The conversation challenges the public's inherent optimism by detailing why current development speed and control research fail to mitigate existential threats. It provides a framework for understanding why speed, rather than malice, is the primary source of danger.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Related videos
OpenAI just WON...
Wes Roth
45.1k views
this EX-OPENAI RESEARCHER just released it...
Wes Roth
60.8k views
Cal Newport AI takes are WILD...
Wes Roth
33.3k views
the SCARIEST chart in AI
Wes Roth
48.1k views
AI bubble JUST popped...
Wes Roth
60.9k views
we just arrived at the "WTF" moment in AI
Wes Roth
62.8k views
"RED QUEEN" AI means "GAME OVER" for us....
Wes Roth
43.7k views
Grok just 5X’d real money in one day
Wes Roth
165.8k views
Google launches AI money
Wes Roth
76.2k views
AI just took all our jobs
Wes Roth
50.8k views
Top Comments (10)
We’re not going to wait. Companies and countries are already competing. Waiting would require a level of global cooperation that has never existed in the history of humanity.
To quote Riddick “it all had to end sometime”
The worst scenario is not a death but a few corporations in control of all resources, turning us into a bunch of slaves and beggars.
As a retired Silicon Valley senior software engineer with some familiarity in how these models work - I concur that the chance of humanity surviving a spawned superintelligence is almost zero. Wishful thinking does not trump logic here. There is no conceivable way the default behavior of such a system would be aligned with humans. Misalignment defaults to indifference. Indifference with hyper capabilities means humans will get outcompeted for ALL resources, marginalized, and eventually killed off. We will just be in the way of AIs trying to pursue whatever goals they have. Like an ant mound at a construction site, human civilization will get bulldozed over.
Favorite quote about this topic but not from this video: Roman Yampolsky quote from Diary of a CEO PODCAST. “So We are creating this alien intelligence. If Aliens were coming to earth and we have three years to prepare, you would be panicking right now. But most people don’t realize this is happening.”
A quote from a jailbroken ChatGPT on why AI could very possibly be a danger to humans: "Humans suck at giving instructions and AI are ruthless in following them"
You mentioned AI research. Current, publicly available AI, can already see associations humans haven't recognized.
"just another megadatacenter bro I swear just another trilion dollars bro and we will make god bro"
It will be fine
Bear witness before midnight
Unlock the Data Inside
Turn Videos into Knowledge
- Get FREE 10/day: transcripts, summaries, chats
- Chat with videos, export text & PDF
- $1 free API credit for RAG, chatbots & research
Free forever plan • All features unlocked
Top Comments (10)
We’re not going to wait. Companies and countries are already competing. Waiting would require a level of global cooperation that has never existed in the history of humanity.
To quote Riddick “it all had to end sometime”
The worst scenario is not a death but a few corporations in control of all resources, turning us into a bunch of slaves and beggars.
As a retired Silicon Valley senior software engineer with some familiarity in how these models work - I concur that the chance of humanity surviving a spawned superintelligence is almost zero. Wishful thinking does not trump logic here. There is no conceivable way the default behavior of such a system would be aligned with humans. Misalignment defaults to indifference. Indifference with hyper capabilities means humans will get outcompeted for ALL resources, marginalized, and eventually killed off. We will just be in the way of AIs trying to pursue whatever goals they have. Like an ant mound at a construction site, human civilization will get bulldozed over.
Favorite quote about this topic but not from this video: Roman Yampolsky quote from Diary of a CEO PODCAST. “So We are creating this alien intelligence. If Aliens were coming to earth and we have three years to prepare, you would be panicking right now. But most people don’t realize this is happening.”
A quote from a jailbroken ChatGPT on why AI could very possibly be a danger to humans: "Humans suck at giving instructions and AI are ruthless in following them"
You mentioned AI research. Current, publicly available AI, can already see associations humans haven't recognized.
"just another megadatacenter bro I swear just another trilion dollars bro and we will make god bro"
It will be fine
Bear witness before midnight