Back to Why Sam Altman is against a single superintelligence, with Sam Altman.
Why Are AI Models Finding PHP Bugs Now?
Sam Altman says the models have been getting good at finding vulnerabilities in the wild, and they keep getting better quickly. People had not pointed them at all the code on the internet. Once that search starts, he expects many more serious vulnerabilities than even the people who already expected a lot.
John Collison says patching the software is not enough. The architecture has to change, which is harder and much more durable. The change would look very hard, except the models are the tool for doing it. A new generation of startups is already talking about a new kind of internet and a new application architecture that assumes the models keep getting smarter.
Why Sam Altman is against a single superintelligence ·
From the transcript
I want to ask about PHP Week. Yeah. First off, how did it... Why did it take so long to find these bugs? Because it sounds like they were kind of... Why did it take like the 20 years, or why did it take the last few months? No, exactly. Why did it take a year? Maybe start by explaining the bug. Or the problem. So the problem is that although we have known for a while that these models are getting good at finding vulnerabilities in the wild, A, they continue to get better fairly rapidly, and B, people just hadn't really used them to go look at everything out there.
There's like a lot of surface area and a lot of code on the internet. And as people have started to do that, I think we're going to find that we are in a world of many more serious vulnerabilities than we expect, even though many people who have been following this for a while expect a lot. Yeah, I just feel like a lot of the discussion ends up being around, we need to fix the software.