Smash Notes

Back to The history and future of AI at Google, with Sundar Pichai, with Sundar Pichai.

How Does Sundar Pichai Judge a Great Product?

Sundar Pichai treats latency as one of the distinguishing features of a great product. A fast response almost always reflects technical underpinnings that were done well. Shipping, iteration, and release cycles are a second kind of speed, and both matter. Latency is the harder one to protect, because teams keep adding capabilities while the capability frontier keeps progressing.

On Google Search, sub-teams now carry latency budgets measured in milliseconds. Ship something that shaves off three milliseconds and the credit is 50%. The team earns 1.5 milliseconds for its latency budget, and 1.5 milliseconds gets passed on to the user.

The split is the balance. Part of a speed win can fund more capability. The rest has to reach the person waiting on the query.

Grokipedia·Sundar Pichai·Google Search

Transcript

The history and future of AI at Google, with Sundar Pichai ·

From the transcript

And so original Google search was really fast and famously displayed the search query time within the results sort of showing off. And then Gmail fast search compared to the competitors at the time or Chrome compared to the competitors at the time. And now, I mean, I use all of the... AI services for different things. But Gemini on TPUs is just so fast.

And I'm curious how much this is part of the explicit product strategy and how you think of it, or it's much more nuanced than that. I've always internalized speed. Let's call it as latency for this purpose, right? And as like one of the distinguishing features of a great product. And also almost always reflects the technical underpinnings of the product having been done well.

See in transcript

Cheeky Pint

More from this episode

  1. Why Didn't Google Ship ChatGPT First?Sundar Pichai says the story that Google invented transformers and then left them unused is misunderstood.
  2. How Does Google Think About Gemini Versus Search?Sundar Pichai says Google should keep both Search and Gemini.
  3. Why Did Google Design Gemini to Be Multimodal?Sundar Pichai says the model where people first saw Google at the frontier was probably Gemini 2.5, and the strength was multimodality.
  4. Does Google Believe AGI Is Close?Sundar Pichai says Google is not less convinced about the curve than the labs people call more AGI-pilled. The spending is the evidence.
  5. Why Can't Spending Solve the AI Memory Shortage?Sundar Pichai says no capitalist incentive will really solve the memory limits of 26 and 27, because there is only so much memory in the world.
  6. Where Will Quantum Computing Matter Most?Sundar Pichai says quantum computing will matter most as a way to simulate nature, because nature is inherently quantum and quantum systems are what it takes…
  7. How Does Google Decide to Keep Funding Waymo?Sundar Pichai says Google decides to keep funding Waymo by reading the underlying technology, not the mood around the demo.
  8. How Does Google Budget Scarce AI Compute?Sundar Pichai says Google has always had a compute budget, including for classic compute, and machine-learning compute is planned next to headcount.
  9. Why Is Google Cloud Benefiting From AI?John Collison says it feels like Google Cloud is really benefiting because the product is so broad that someone can tell AI to go add a Google Cloud feature…
  10. How Is Google Changing How Its Teams Build Software?Sundar Pichai says the workflow change inside Google is moving in concentric circles.
  11. What Limits AI Adoption Inside a Large Company?Sundar Pichai says the Gemini teams, the Gemini enterprise teams, and the Anti-Gravity teams are working on the adoption problems that show up once the models…

People

More answers like this

The other side

More with Sundar Pichai

More with John Collison

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.