Back to Intelligence Isn't Power.
Why Does Arvind Narayanan Call Power Seeking Engineered?
Arvind Narayanan says there is evidence for many harmful capabilities, and no evidence yet for power seeking. He would not treat power seeking as an emergent property. If it happens, it would be an engineered property, and people have agency over which properties get engineered into artificial intelligence systems.
From the transcript
That's one part of it. And power-seeking as well, I mean, I think we've seen, you know, evidence for lots of harmful capabilities in the recent episodes. I don't think we've seen evidence of power-seeking, and I wouldn't treat that as an emergent property. If it happens, that would be an engineered property. And again, we have agency over what kinds of properties we engineer into these systems.
So there's a lot here. I actually agree with you on persuasion. I have never been persuaded that you are going to make these necessarily super persuasive AIs capable of doing the things we talk about.
I guess the, again, the unnerved feeling I have when I'm sitting in this debate, though, is a little bit more of a reasoning from deeper principles. So