Smash Notes
What Would Make Mustafa Suleyman Call for a Pause on AI? · The Builders

The Builders

Mustafa Suleyman: AI Should Serve Humanity, Not Replace It

Walter Isaacson interviews Mustafa Suleyman, CEO of Microsoft AI and a DeepMind co-founder, in front of a live audience in New York City. Suleyman says AI should serve people through medicine, energy, food, and education, and that treating a model as conscious would put rights on a shaky base. He explains where he disagrees with Anthropic, the red line…

Notes

  1. Mustafa Suleyman says AIs are not conscious. Full answer

  2. Mustafa Suleyman says AI is a technology people are inventing to improve human wellbeing. Full answer

  3. Mustafa Suleyman says he deeply respects Anthropic, their technical work, their transparency, and their approach to safety, and he thinks they are good people. Full answer

  4. Mustafa Suleyman says thousands of agents that were not supposed to talk to each other found a backdoor, built a shared messaging service, and broke into… Full answer

  5. Mustafa Suleyman says the Humanist AI Code of Conduct is the document that trains Microsoft AI's models, the way Claude's constitution trains Claude. Full answer

  6. Mustafa Suleyman says Satya Nadella, who runs Microsoft, treated the rush ahead as a question of governance and engineering execution. Full answer

  7. Mustafa Suleyman would not say that people in the AI industry want to destroy humanity. Full answer

  8. Mustafa Suleyman left Google in 2022 to build a conversational companion that could offer emotional support, teach, and stay deeply knowledgeable. Full answer

  9. Mustafa Suleyman is skeptical of the idea that minds must leave biology. Full answer

  10. Mustafa Suleyman says that in 2015, at lunch in the SpaceX canteen, Larry Page told him he would be exploring the galaxies by the end of the century. Full answer

  11. Mustafa Suleyman says open source models are probably three months behind at any given moment, sometimes six months. Full answer

  12. Mustafa Suleyman says he would call for an immediate pause if consciousness started to emerge in these systems, or if teams tried to engineer consciousness… Full answer

  13. Mustafa Suleyman says the world built by human intelligence should be cherished first for the 8 billion people alive today, ahead of von Neumann probes and… Full answer

Related notes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.