Back to The Bumpy Road To AGI — With Kevin Roose, with Kevin Roose.
Why Did Kevin Roose Lower His Odds of AI Doom?
Kevin Roose's probability of doom has gone down in the last few weeks because everyone is freaking out about AI risk, a shift he links, with some hesitation, to feeling paradoxically less worried.
Before Jacob Coxon resigned from Anthropic, and before Hugging Face, almost no one thought about AI risk or existential threats. The only people thinking about it were weirdos in the Bay Area. Now people on the street ask about it, and people at dinner tables talk about it. High school classmates he has not spoken with in 15 years text to ask whether everyone is going to die.
He frames the new attention as a possible movie moment, humanity banding together to save itself from an asteroid, and he stops short of treating the rescue as certain. A lot still has to go right. Waking up to the risk was the first hurdle, and the next task is figuring out what to do. Optimism rests on slowing development and buying more time for better ways of controlling the systems. He wants AI built to cure cancer and disease and to help people live longer, healthier lives, and he does not want to file expenses by hand. He wants the technology in daily life. Holding safety and control together is what would make the result amazing.
The Bumpy Road To AGI — With Kevin Roose ·
From the transcript
Any note of optimism or anything that makes you optimistic? Yes, so I often tell people my P. doom has gone down in the last few weeks
because- Because of the pre-orders of the book or? No, because everyone is freaking out now, which paradoxically maybe makes me feel less worried. Before Jacob Coxon resigned from Anthropic, before Hugging Face, Like no one really thought about AI risk or existential threats, or it was just like weirdos in the Bay Area who were thinking about it.
And now like people on the street are asking about it. People at their dinner tables are talking about it. I'm getting texts from people I went to high school with who I haven't talked to in 15 years being like, are we all gonna die? And to me, that is, it feels like it could be the moment in the movie where humanity bands together to save itself from the asteroid.