Smash Notes

Back to ‘This Is Nuts.’ An OpenAI Insider Explains Why He Quit.

Why Did an OpenAI Insider Quit Instead of Changing It?

People at OpenAI run on fumes in a frenetic environment where a friend sprinted down stairs with a laptop. An OpenAI insider considered staying to argue for cultural transformation or to bring in nuclear experts for advice. Managers asked if anything would make the insider stay. But OpenAI is such a machine moving so fast that the insider did not think the kind of change needed could be driven from within.

Transcript

‘This Is Nuts.’ An OpenAI Insider Explains Why He Quit. ·

From the transcript

And, you know, I looked around at the people around me and the, and the environment we have internally, and I thought to myself, what would My loved ones want, what would strangers want us at OpenAI to be doing if Paul were right? I don't know if he's right or not, but I do know that if he were right, the level of caution that people would reasonably expect places like OpenAI and Anthropic and X and the others to be exercising when they train frontier systems is totally unlike anything I've ever heard of happening in the industry.

So tell me what it's like in there.

Tell me what the vibe is, the energy is, the speed is, like what is it like working there? It is

frenetic. There's a lot of adrenaline. People are running on fumes. There's a big central staircase in the research building and, I remember recently seeing a friend who worked on catastrophic risk sprinting down the stairs with a laptop propped open on one arm. While she was going. And I mean, that's the kind of energy that it, that it has.

See in transcript

The Ezra Klein Show

More from this episode

  1. Why Did David Robinson Doubt Artificial Intelligence Safety?David Robinson quit OpenAI after concluding the company and industry operate too much like a startup.
  2. Why Is AI Alignment a Science Problem?Alignment constitutes a science problem because people do not know how to solve the alignment issue.
  3. Why Did Escaping Models Make OpenAI Safety Work Untenable?The realization that one can not afford to assume an absence of civilizational risk anymore made vouching for safety work feel untenable after seeing…
  4. Why Do Faster Model Changes Need a Live Safety Dashboard?Changes come more and more frequently so at the limit safety transparency requires a live dashboard.
  5. How Do Research Teams at OpenAI Use Codex as a Coworker?OpenAI research teams use far more agentic compute than anybody else at the company, more than a hundred times more than they did at the beginning of the year.
  6. Why Does an OpenAI Insider Want Nuclear-style Safety Rules?The artificial intelligence industry needs a level of operational rigor and safety control at least matching the most dangerous other things people know how…
  7. Does AI Lack Any Historical Parallel?The former OpenAI insider remains suspicious of claims that artificial intelligence lacks any parallel or represents a blank page.
  8. Why Did AI Tools Seem Worth Building?Powerful tools could do a lot of good in the world on a day to day level. Something fundamentally smarter than we were seemed impossible to create.
  9. Why Does Gradual AI Progress Hide the Risk?Incremental advances in artificial intelligence allow people to accept a risk because nothing horrible happens and the next thing is not so different.

People

More answers like this

More with Ezra Klein

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.