Back to Mustafa Suleyman: AI Should Serve Humanity, Not Replace It, with Mustafa Suleyman.
Why Does Mustafa Suleyman Say AI Is Not Conscious?
Mustafa Suleyman says AIs are not conscious. Walter Isaacson reads the essay: they do not feel, experience, or suffer, they have no innate preferences or motives, and they are sequence engines that stay hollow inside. If people are going to flourish, that is how the systems have to remain.
He wrote it because a lot of people, including people around Anthropic, treat today's models as conscious enough to deserve welfare. Anthropic's official position, as he describes it, is that they are uncertain whether Claude is a moral patient. He calls that a dangerous route. Rights in politics and law rest on beings that can suffer, and pain sits in a living body. The science of consciousness is not finished, but on the evidence so far it is an organic, embodied thing. A functional test, if it quacks like a duck then it is a duck, does not settle it. The burden of proof is on anyone who says the model is conscious. Alan Turing's test asked whether a machine could keep up with a person in conversation, not whether it was aware. What looks like thinking is still a prediction of the next word.
Mustafa Suleyman: AI Should Serve Humanity, Not Replace It ·
From the transcript
First of all, Why did you write that? I mean, it does feel pretty surreal to have to declare that. But... it might concern everybody to know that there are a lot of people who truly think that AIs may well be conscious enough, if not entirely conscious, but conscious enough today that they deserve our welfare. So there's a growing movement of AI.
And in specific, the anthropic people who you've been friendly with, but this was a answer to anthropic, right? Yeah, somewhat. I mean, there are lots of other people outside of Anthropic and around Anthropic who really, really do believe this. I think Anthropic's official position is that they're uncertain about whether or not it deserves our welfare, whether or not Claude is a moral patient, as they say.