Smash Notes

Back to Arvind Krishna & Nikesh Arora: Quantum Threat, Open vs Frontier AI, AI Cyber Warfare & SaaS Collapse, with Arvind Krishna & Nikesh Arora.

Should Teams Use the Best AI Model First?

Nikesh Arora says that in the experimentation phase a company should use the best model it can find, in the easiest way. He says not to restrict the team, not to cost-optimize, and not to stitch a private stack yet.

Two teams at his company, twenty people rather than twenty thousand, have just discovered AI in the last twelve to eighteen months, and adoption is not fully diffused. Making the tools harder slows that down. Arora calls the easy-adoption stretch phase one. After that, different tasks need different models. Inspecting all traffic at an endpoint costs twenty dollars a year, or twenty to twenty-five dollars a year. Sending that traffic through a token-priced model is not practical. He says to compress a small language model, make it task specific, and train it until it reaches 99.9 percent accuracy.

A frontier model is for the rare case, such as an active breach whose business impact he puts in the billions of dollars. For most practical enterprise use, and for a defender model in peacetime, Arora says to take an open-weight model, train it on proprietary data, and manage the weights.

Transcript

Arvind Krishna & Nikesh Arora: Quantum Threat, Open vs Frontier AI, AI Cyber Warfare & SaaS Collapse ·

All-In

More from this episode

  1. When Could a Quantum Computer Break Today's Encryption?Arvind Krishna puts a working quantum computer that breaks today's cryptography at 2030.
  2. How Often Are AI-found Code Flaws Real?Nikesh Arora says a model that has learned what good code looks like can also point at bad code. Attackers only need one real vulnerability.
  3. Will Agent-written Code Beat Human-written Code?Arvind Krishna says agent-written code will be superior to human-written code.
  4. Will Every State Ban Data Centers?Arvind Krishna says there is no chance all 50 states will ban data centers. A ban in 30 states is possible, and the remaining 20 would rub their hands in glee.
  5. Why Will Enterprise Software Vendors Consolidate?Nikesh Arora says there is going to be a huge disruption in the SaaS space over the next few years. Arvind Krishna builds on that point.
  6. Can AI Software Replace a Bank Lookup?Arvind Krishna says replacing a database lookup for retail banking, or the work of closing the books, with AI-generated software is going to be hard.

People

More answers like this

The other side

More with Nikesh Arora

More with Chamath Palihapitiya

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.