How Often Are AI-found Code Flaws Real?
at 16:41
Answer
Nikesh Arora says a model that has learned what good code looks like can also point at bad code. Attackers only need one real vulnerability. Defenders have to find every one and patch it.
When Mythos first looked for bad code, Arora says it was hallucinating 30 percent of the time. He guesses that among people who have tested those findings, roughly 60 to 80 percent have been real and 20 percent have been hallucinations. He does not think anyone will patch from a flawed suggestion without testing it again.
Where this answer comes from
People
More notes from this episode
- When Could a Quantum Computer Break Today's Encryption? Transcript
- Should Teams Use the Best AI Model First? Transcript
- How Often Are AI-found Code Flaws Real? Transcript
- Will Agent-written Code Beat Human-written Code? Transcript
- Will Every State Ban Data Centers? Transcript
- Why Will Enterprise Software Vendors Consolidate? Transcript
- Can AI Software Replace a Bank Lookup? Transcript
More answers like this
- Should Teams Use the Best AI Model First?
- Will Agent-written Code Beat Human-written Code?
- When Could a Quantum Computer Break Today's Encryption?
- Will Every State Ban Data Centers?
More with Chamath Palihapitiya
- Why Should Anthropic Raise $200 Billion Now?
- How Close Is CoreWeave to Its Breakeven?
- What Default Odds Did CoreWeave's Swaps Imply?
- Why Is Bill Gates the AI Doomer?
- Why Did CoreWeave Bonds Crush the Cloud Stocks?
- Is Software Intellectual Property Now Worthless?
More with Jason Calacanis
- Why Does Ben Horowitz Own Both AI Labs?
- What Leaked From Anthropic's Investor Day?
- Why Did Bill Gates Retire to Be Loved?
- Is the CoreWeave Crash Just Market Volatility?
- Did Jason Calacanis Want Lockdown Policy Judged by Its Side Effects?
- What Makes for a Healthy Work-life Balance
Related episodes
- CoreWeave Crash, AI Trade Cracks, Anthropic IPO Red Flags, Bill Gates Doomer
- COVID-19 & Impact on Startups, Venture Capital & Public Markets
- COVID-19 Political, Economic & Social Ramifications
- Dylan Field: Is AI Replacing Designers?, Design is the New Code & Democratizing Creativity
- E291: Trump's Super Intelligence Summit, AI Safety Accord, GDP Beats, Midterm Predictions
- Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots
- Is There an A.I. Bubble? A Debate.
- Perplexity CEO: SMBs Could Drive the Next Economic Boom