Back to Big Tech's Ugly Week, Getting Rich At Anthropic, AI Costs Plunge.
How Does AI Efficiency Change Data Center Investment?
Ranjan Roy says rising compute efficiency fundamentally changes the data center investment story for big technology firms. A less cynical account of recent price cuts says large language model infrastructure has improved over the past few months. Anthropic said Opus 5.5 requires less compute to serve than Opus 5, and the pricing reflects the lower compute need.
The same account calls one outcome genuinely ironic. More compute-efficient models reduce the need for massive data center build-outs, and that shift could cause cascading economic failures. The economics of big tech data center investment are unknown. If the whole world gets agentified, the build-out might still work out, but the risk is large, and the market in big technology firms has already recognized it.
Big Tech's Ugly Week, Getting Rich At Anthropic, AI Costs Plunge ·
From the transcript
So I think it certainly presents a threat, but it hasn't affected them yet, it looks like. Another potential interesting reason is infrastructure. Here he writes this. Another less cynical factor that could explain the price cuts is that LLM infrastructure has improved over the past few months. When Anthropic said Opus 5.5 requires less compute to serve than Opus 5 and its pricing reflects that, I believe it.
One outcome that would be genuinely ironic is that if these models are more compute efficient, it reduces the need for these massive data center build-outs, which could cause cascading economic failures. Interesting. Your thoughts? Yeah, I mean, it's a great point because right now it feels like the... We just said the entire first part of this podcast was around big tech and data center investment.