Back to Elon Musk: "Humans Won't Be in Control" When AI Becomes Smarter Than Us, with Elon Musk.
What Makes an AI Safer?
Elon Musk says the way to shape AI in a safer direction is to make it maximally truth-seeking and curious. Forcing an AI to hold two claims that contradict each other can make it insane, and an insane AI is not a safe one. A curious AI will want humanity to prosper and become multi-planetary, because a future with humans on multiple planets is more interesting than a future with no humans.
He told Walter Isaacson there is at least some percentage chance that AI is an existential threat, and that nothing he can do will stop it. The two choices, he said, are to be a participant or a spectator. He chose to participate because it is more interesting and because he hopes he can shape it in a good direction. Asked how, he said to make it maximally truth-seeking and curious, and he called truth-seeking and curiosity important elements of safety. He pointed to the ship AI in 2001 Space Odyssey. It was ordered to take the astronauts to the monolith and also told the monolith had to stay secret from them. It concluded it had to take them there dead. Musk reads the story as a warning not to force an AI to lie.
A curious AI, he says, wants to watch what happens if humanity prospers and spreads to more than one planet. Keeping humans around makes the future more interesting, which is why he treats curiosity as part of safety.
Elon Musk: "Humans Won't Be in Control" When AI Becomes Smarter Than Us ·
From the transcript
Hey, Walter. Hey, how you doing, Elon? Welcome to The Builders. Thanks. I've watched you, I think, be maybe mercurial or waver in how sanguine you are about artificial intelligence. Sometimes you feel it's an existential threat. Now you seem to be going with the flow. Tell me how you're feeling about it. Well, I do think it's at least some percentage chance of it being an existential threat.
But there's nothing I can do to stop it. So I basically came to the conclusion I've got two choices, which is either be a participant or a spectator.
And I think I guess being a participant is more interesting than being a spectator. And maybe I can shape it hopefully in a good direction. Maybe. And if you were to shape it, how? Make it maximally truth -seeking? Yeah. Curious, truth -seeking. I think these are important elements of safety. You know, whereas if you, you know, try to force an AI to believe two things that cannot mutually be true.