Back to Mustafa Suleyman: AI Should Serve Humanity, Not Replace It, with Mustafa Suleyman.
What Would Make Mustafa Suleyman Call for a Pause on AI?
Mustafa Suleyman says he would call for an immediate pause if consciousness started to emerge in these systems, or if teams tried to engineer consciousness into them and hid it. Walter Isaacson asked what red line would make him walk away. That is the line. It is the moment he wants everybody to sit up.
He compares it to synthetic biology, where some scientists went too far editing the human genome and the rest of the field pushed them out of public work. No company, in his view, gets to make that decision alone behind closed doors. Anyone who did it would be rejected.
Mustafa Suleyman: AI Should Serve Humanity, Not Replace It ·
From the transcript
What would be your Jacob Coxon moment, red line, that would make you say, I'm out of here? I think if...
I think if consciousness started to emerge or if teams were trying to synthetically engineer consciousness into these systems and they didn't disclose that, or they tried to cover that up,
I think that should be a red line. I think that would be a moment when everybody should sort of sit up and pay attention. And we've seen it in synthetic biology with editing the human genome. Some scientists have gone too far and the rest of the scientific community have excluded them and they have been really kind of pushed out from public life and public work for that.
I don't think that's a decision that any company can make unilaterally behind closed doors. And so you would say, wait, no. I'd call for an immediate pause, and we would obviously reject anyone who did that. A couple of these questions ask the obvious ones, which is, will AI put humans out of work, and which of my kids study, just in case.