Smash Notes

Back to Is There an A.I. Bubble? A Debate., with Paul Kedrosky & Azeem Azhar.

Is OpenAI and Anthropic's Chip Revenue Share Falling?

Ezra Klein asks how AI demand looks once token use is separated from the chips that serve it. Azeem Azhar says the asset under investment is data centers, and 65% of the cost is the chip, the GPU or the AI accelerator. The environment is compute constrained because people are making extremely good returns in 18 to 24 months on an asset, since they can charge Uber surge pricing for the GPUs.

Amazon, Microsoft, and Google, and new labs called NeoClouds, buy billions of the GPUs, put them in data centers that now will start to cost billions of dollars, and rent the GPUs out. About 50% of the revenues go to Anthropic and OpenAI for their spending. The other 50% is a mix of other AI companies and firms running open source models or open weight models on the hyperscalers infrastructure. If the ratios stayed the same for the next three or four years, Azeem Azhar says the result would be someone effectively paying themselves around the back door.

The ratio has been declining because the hyperscalers are getting more and more business from real customers. Azeem Azhar takes the shift as a sign of a market maturing week after week, quarter after quarter.

Transcript

Is There an A.I. Bubble? A Debate. ·

The Ezra Klein Show

More from this episode

  1. Would an OpenAI Collapse Pop the Economy?Azeem Azhar says Paul Kedrosky talked about frontier models and tokens, while he talked about capital spending and the GPUs, and that the two deserve separate…
  2. What Did Anthropic's Hiring Leak Reveal About Meta?Azeem Azhar says Anthropic accidentally leaked one of its largest customers.
  3. How Did Apple Gain by Skipping Frontier Models?Ezra Klein says Apple decided not to compete in making a frontier model, unlike Alphabet, Google, and Meta. OpenAI and Anthropic are AI companies.
  4. How Is Wall Street Loading Debt Onto Big Tech?Ezra Klein asks whether broader society is protected because Alphabet, Meta, and the other major companies can absorb huge losses on their own balance sheets.
  5. Why Is AI Repricing Cognitive Work?Paul Kedrosky says artificial intelligence is the fastest adopting technology in history, and its fundamental function is to reprice cognitive labor.
  6. How Likely Is a Backlash Against AI?Ezra Klein says discontinuous regulation is quite likely.
  7. How Few Jobs Does a Huge Data Center Create?Azeem Azhar says a huge data center may cost billions of dollars and still employ a handful of people.
  8. Which Books Do Paul Kedrosky and Azeem Azhar Recommend?Ezra Klein asks each guest for three books. Paul Kedrosky recommends Middlemarch, about normal people swept along as a technology revolution takes hold.

People

More answers like this

More with Ezra Klein

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.