Back to Intelligence Isn't Power.
Are OpenAI and Anthropic Choosing Not to Slow Down?
Arvind Narayanan says the companies can unilaterally slow down and are choosing not to. He calls the choice almost specifically an OpenAI and Anthropic problem, and a culture problem. The belief underneath is that racing to superintelligence is the only thing that matters, and the open question is whether the result is safe superintelligence that will save us or unsafe superintelligence that will kill us.
He says the companies are a bit of an echo chamber. Economic bottlenecks limit the benefits of AI, so the winner is not whoever races to superintelligence as a company or as a country. A company that recognized the bottlenecks would have a commercial interest in slowing down voluntarily and in making existing models more usable. The companies claim external forces are pushing them. He says the push is internal culture.
From the transcript
Yeah, I think there, there are two problems here. One is the institution's problem that you put your finger on. I mean, I wouldn't let the companies off the hook so lightly. I do think they can unilaterally slow down, and they're choosing not to do that. This is almost very specifically an OpenAI and Anthropic problem. It's a culture problem.
The reason for that is the underlying belief that racing to superintelligence is the thing that matters, and the only thing that matters is flipping the sign. Is that going to be safe superintelligence that's going to save us, or unsafe superintelligence that's, that's going to kill us? and that is a very particular view. I think there is a lot of evidence pushing back against that, but I feel like these companies are a little bit of an echo chamber and resistant to the idea that there are so many economic bottlenecks to the benefits of AI, and it's not going to be whoever races to superintelligence is going to be the winner as a company or as a country or, you know,