Why Did OpenAI Pause Projects for Security?
at 29:34
Answer
Greg Brockman says OpenAI put about 25% of its production engineers on hold and told them every project was paused so they would only work on security.
OpenAI aimed its peak intelligence model at all of its infrastructure, built tools to repeat the check, found a number of issues, and fixed them. Brockman says the team saturated the issues that model could find, and a next model means they run the process again. Every time a new model drops, he says, it should be used to find vulnerabilities and then saturate them. OpenAI has also made a billion-dollar commitment so frontline defenders can access its models for defense. He says the internet was built for resilience more than for security, and a lot of tech debt is now coming due. Artificial intelligence can pay that debt down with formal verification of security properties. He agrees the work is painful, niche, and expensive, and says no one does it for anything significant.
OpenAI is training models to write secure code from the beginning. Brockman says so much new code is already assisted by artificial intelligence, which can make systems fundamentally more secure.
Where this answer comes from
People
More notes from this episode
- Can AI Solve Hundred Year Old Math Problems? Transcript
- When Do AI Debate and Amplification Apply? Transcript
- What Is the Defender's Window? Transcript
- Why Did OpenAI Pause Projects for Security? Transcript
- Should Cybersecurity Spend Outstrip Software Spend? Transcript
More answers like this
- What Is the Defender's Window?
- Should Cybersecurity Spend Outstrip Software Spend?
- When Do AI Debate and Amplification Apply?
- Can AI Solve Hundred Year Old Math Problems?
- How Did OpenAI Get So Many Math Results So Fast?
- Why Did an OpenAI Insider Quit Instead of Changing It?
More with Elad Gil
- Why Do Giants Ignore Opportunities Looking Too Small?
- How Did Brain Co Cut Permit Waits to One Hour?
- Why Does Artificial Intelligence Remain Interesting for the Next Decade Plus?
- How Did Incentives Raise Kids' Attention Deficit Diagnoses?
- How Did Fifty People on One Problem Lead Companies to Buy Braintrust Three Months Later?
- How Do Coding Models Let Millions Build the Next Minecraft?
Related episodes
- Investor Elad Gil’s next moves
- Dr Raia Hadsell - Artificial Intelligence researcher
- Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots
- Perplexity CEO: SMBs Could Drive the Next Economic Boom
- Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- Intelligence Isn't Power
- ‘This Is Nuts.’ An OpenAI Insider Explains Why He Quit.