Smash Notes

Back to The Changing Physics of Cybersecurity and Drug Development with OpenAI President Greg Brockman, with Greg Brockman.

Why Did OpenAI Pause Projects for Security?

Greg Brockman says OpenAI put about 25% of its production engineers on hold and told them every project was paused so they would only work on security.

OpenAI aimed its peak intelligence model at all of its infrastructure, built tools to repeat the check, found a number of issues, and fixed them. Brockman says the team saturated the issues that model could find, and a next model means they run the process again. Every time a new model drops, he says, it should be used to find vulnerabilities and then saturate them. OpenAI has also made a billion-dollar commitment so frontline defenders can access its models for defense. He says the internet was built for resilience more than for security, and a lot of tech debt is now coming due. Artificial intelligence can pay that debt down with formal verification of security properties. He agrees the work is painful, niche, and expensive, and says no one does it for anything significant.

OpenAI is training models to write secure code from the beginning. Brockman says so much new code is already assisted by artificial intelligence, which can make systems fundamentally more secure.

Grokipedia·OpenAI·Greg Brockman

Transcript

The Changing Physics of Cybersecurity and Drug Development with OpenAI President Greg Brockman ·

No Priors: Artificial Intelligence | Technology | Startups

More from this episode

  1. Can AI Solve Hundred Year Old Math Problems?Greg Brockman says AI can resolve hundred year old math problems, and whether AI can come up with new knowledge now has a definitive yes.
  2. When Do AI Debate and Amplification Apply?Greg Brockman says debate and iterative amplification, techniques discussed since 2017 and two sides of a similar coin, apply when AIs solve problems too hard…
  3. What Is the Defender's Window?Greg Brockman says the defender's window is the current phase of cybersecurity, when peak frontier AI can help defenders secure their systems and the…
  4. Should Cybersecurity Spend Outstrip Software Spend?Greg Brockman believes cybersecurity spend should vastly outstrip software spend. He says he may not be right, and he still holds the view.

People

More answers like this

More with Sarah Guo

More with Elad Gil

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.