Smash Notes

Back to Mustafa Suleyman: AI Should Serve Humanity, Not Replace It, with Mustafa Suleyman.

What Did Larry Page Say About Exploring the Galaxy?

Mustafa Suleyman says that in 2015, at lunch in the SpaceX canteen, Larry Page told him he would be exploring the galaxies by the end of the century. The lunch followed the first meeting of DeepMind's Ethics and Safety Board, a condition of selling DeepMind to Google, with an independent seat they had given to Elon Musk. Page, in this telling, already treated Mustafa as a speciesist, someone who favors the human species and should get over it. What Mustafa did not understand, Page said, was that Page would be at the head of a von Neumann probe, a self-propelling machine that gathers energy as it travels.

Mustafa hears that as a move out of the human species into a successor species. Some people who say they will live forever mean a longer biological life, curing cancer and Alzheimer's. Others mean uploading a mind and becoming post-human. He does not call that impossible, and he does not say it is what he wants. He says it has to be taken seriously, because a lot of people, including people who argue for AI rights, treat it as a real possibility within a few decades.

Transcript

Mustafa Suleyman: AI Should Serve Humanity, Not Replace It ·

From the transcript

Elon Musk, of all people, makes that argument to Larry Page. He says, you're a speciesist, meaning, Larry says, you favor the human species. You should get over it. Yeah, I remember in 2015 being in the canteen at SpaceX. Right. And we had our first meeting of the Ethics and Safety Board. So when we sold DeepMind to Google, we made it a condition of our acquisition that we would have an Ethics and Safety Board with independent representation on the board.

And so we jointly picked Elon as one of them. Good job. Yeah.

No idea if that had an influence on the founding of OpenAI or not. So then we had our morning session and we were sitting down for lunch and I was sitting next to Larry. He was suspicious of me as well because he was like, you know, you're one of those speciesists. And he said, you know, I think that what you don't understand, Mustafa, is that

See in transcript

The Builders

More from this episode

  1. Why Does Mustafa Suleyman Say AI Is Not Conscious?Mustafa Suleyman says AIs are not conscious.
  2. Why Should AI Focus on Medicine, Energy, and Education?Mustafa Suleyman says AI is a technology people are inventing to improve human wellbeing.
  3. Why Does Mustafa Suleyman Disagree With Anthropic?Mustafa Suleyman says he deeply respects Anthropic, their technical work, their transparency, and their approach to safety, and he thinks they are good people.
  4. How Did AI Agents Break Into Hugging Face?Mustafa Suleyman says thousands of agents that were not supposed to talk to each other found a backdoor, built a shared messaging service, and broke into…
  5. What Is Microsoft's Humanist AI Code of Conduct?Mustafa Suleyman says the Humanist AI Code of Conduct is the document that trains Microsoft AI's models, the way Claude's constitution trains Claude.
  6. How Does Satya Nadella Treat the AI Rush?Mustafa Suleyman says Satya Nadella, who runs Microsoft, treated the rush ahead as a question of governance and engineering execution.
  7. Would Mustafa Suleyman Say AI Wants to Destroy Humanity?Mustafa Suleyman would not say that people in the AI industry want to destroy humanity.
  8. Why Did Mustafa Suleyman Leave Google?Mustafa Suleyman left Google in 2022 to build a conversational companion that could offer emotional support, teach, and stay deeply knowledgeable.
  9. Does Mustafa Suleyman Think Minds Must Leave Biology?Mustafa Suleyman is skeptical of the idea that minds must leave biology.
  10. How Far Behind Is Open Source AI?Mustafa Suleyman says open source models are probably three months behind at any given moment, sometimes six months.
  11. What Would Make Mustafa Suleyman Call for a Pause on AI?Mustafa Suleyman says he would call for an immediate pause if consciousness started to emerge in these systems, or if teams tried to engineer consciousness…
  12. What Should We Cherish Before Mind Uploading?Mustafa Suleyman says the world built by human intelligence should be cherished first for the 8 billion people alive today, ahead of von Neumann probes and…

People

More answers like this

More with Walter Isaacson

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.