Smash Notes

How Often Are AI-found Code Flaws Real?

at 16:41

From the episode: Arvind Krishna & Nikesh Arora: Quantum Threat, Open vs Frontier AI, AI Cyber Warfare & SaaS Collapse

Answer

Nikesh Arora says a model that has learned what good code looks like can also point at bad code. Attackers only need one real vulnerability. Defenders have to find every one and patch it.

When Mythos first looked for bad code, Arora says it was hallucinating 30 percent of the time. He guesses that among people who have tested those findings, roughly 60 to 80 percent have been real and 20 percent have been hallucinations. He does not think anyone will patch from a flawed suggestion without testing it again.

Where this answer comes from

People

More notes from this episode

More answers like this

More with Chamath Palihapitiya

More with Jason Calacanis

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.