Smash Notes

Back to Big Tech's Ugly Week, Getting Rich At Anthropic, AI Costs Plunge.

How Does AI Efficiency Change Data Center Investment?

Ranjan Roy says rising compute efficiency fundamentally changes the data center investment story for big technology firms. A less cynical account of recent price cuts says large language model infrastructure has improved over the past few months. Anthropic said Opus 5.5 requires less compute to serve than Opus 5, and the pricing reflects the lower compute need.

The same account calls one outcome genuinely ironic. More compute-efficient models reduce the need for massive data center build-outs, and that shift could cause cascading economic failures. The economics of big tech data center investment are unknown. If the whole world gets agentified, the build-out might still work out, but the risk is large, and the market in big technology firms has already recognized it.

Transcript

Big Tech's Ugly Week, Getting Rich At Anthropic, AI Costs Plunge ·

From the transcript

So I think it certainly presents a threat, but it hasn't affected them yet, it looks like. Another potential interesting reason is infrastructure. Here he writes this. Another less cynical factor that could explain the price cuts is that LLM infrastructure has improved over the past few months. When Anthropic said Opus 5.5 requires less compute to serve than Opus 5 and its pricing reflects that, I believe it.

One outcome that would be genuinely ironic is that if these models are more compute efficient, it reduces the need for these massive data center build-outs, which could cause cascading economic failures. Interesting. Your thoughts? Yeah, I mean, it's a great point because right now it feels like the... We just said the entire first part of this podcast was around big tech and data center investment.

See in transcript

Big Technology Podcast

More from this episode

  1. What Share of Google Searches End in AI Mode?Ranjan Roy says the share of Google searches that end in AI mode jumped from 2% to 8.9%, and Google does not know how to monetize AI mode yet.
  2. Why Does Meta Lead Ad Revenue by 2028?Alex Kantrowitz reads economist Steve Howe's chart, which puts Meta ahead on ad revenue in 2028 by a good margin after Google led in 2024, because Google has…
  3. Why Are Meta and Amazon Ads Better Placed Than Google?Ranjan Roy says Meta and Amazon sit in a much better position on advertising because their ads live inside closed products, while Google's open-web model is…
  4. Why Does Ranjan Roy Keep an Echo Show in the Kitchen?Ranjan Roy keeps an Echo Show in the kitchen and uses it while cooking. The device is very thirsty.

People

More answers like this

More with Alex Kantrowitz

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.