Smash Notes

Back to Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028, with Dylan Patel.

Will Anthropic and OpenAI Control Most AI Compute by 2028?

Dylan Patel says Anthropic and OpenAI are on track to control most of the usable compute in the world by the end of 2028, and he sees nothing that stops the trend.

OpenAI started this year at two and Anthropic at less than two. Both finish the year above five, about three or four times as much compute together, and about 30 percent of the compute added this year. Deals already signed put the two labs at 40 to 50 percent of compute next year, and by the end of next year half of new compute goes to them. Because compute is growing so fast, the new compute is most of the usable compute. Additions run about 30 gigawatts this year, 50 next year, and 70 the year after. Newer chips also do three to five times the performance per watt, so that new half is worth more than the older stock. If the labs take 45 percent next year, by December 2027 they hold half of the new compute, and by the end of 2028 they control most of the usable flops.

SpaceX is building a large share and is likely to lease it to the labs, because they can pay the highest price. OpenAI is building its own chips. Anthropic is buying TPUs from Google and deploying them with Fluidstack.

Transcript

Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028 ·

From the transcript

Where if you say right now, a third of marginal compute is going to the labs. by when is it over half of the incremental compute in the world is going to the labs? And by what point do the labs have basically a vast majority of the world's compute? Yeah, so earlier this year, the beginning of this year, Anthropic OpenAI started at two for OpenAI and less than two for Anthropic.

End of this year, they're both above five. So they have three, four X compute as a whole.

When you look at the incremental compute added, that's about 30 percent of the compute added this year. And as we step forward to next year, given what's already been signed and penned and inked, you've got something even more dramatic, right? You've got Anthropic OpenAI are taking as much as 40 to 50 percent of compute next year. And the centralization doesn't look like it's slowing down or stopping.

See in transcript

Dwarkesh Podcast

More from this episode

  1. How Much Revenue Does Anthropic Make Per Megawatt?Dylan Patel says Anthropic's revenue has gone as high as $50 million per megawatt, while the base cost of compute runs around $10, $13, or $15 million per…
  2. Why Can't AI Labs Fund Next Year's Buildout?Dylan Patel says the labs can spend hundreds of billions of dollars and will generate hundreds of billions of revenue next year, but capital spending next…
  3. What Must AI Labs Pay Per Megawatt in 2028?Dylan Patel says the labs will keep buying a larger share of the world's compute, but they cannot do it at today's prices or anywhere close.
  4. Who Captures the Value That AI Models Create?Dylan Patel says most of the value these models create does not go to OpenAI or Anthropic. So far it goes mostly to the users.
  5. Will AI Labs Shift More Compute Into Training?Dylan Patel believes the labs will allocate less and less compute to inference over time and ratchet up the share dedicated to training.
  6. How Much AI Compute Will the World Have by 2028?Dylan Patel agrees that adding his yearly figures puts world AI compute over 200 gigawatts by the end of 2028, and he confirms that total is global.
  7. How Much AI Compute Will China Have by 2028?Dylan Patel says China will have about 30 gigawatts of AI compute or less in 2028, and China's share of new data-center compute stays under 10 percent.
  8. How Much Power Does Anthropic's Mythos Pre-train Use?Dylan Patel says Anthropic's Mythos pre-train uses under 200 megawatts for about two months, even while Anthropic is nearly five gigawatts by the end of the…
  9. Why Can't an AI Release Ban Stop a Singularity?Dylan Patel's main worry is a singularity that a public release ban fails to stop, because outside deployment is what is helping.
  10. How Fast Is Frontier AI Labor Growing?Dwarkesh Patel says the effective AI workforce at frontier labs is growing about 10 times a year, and one lab could hold more labor than the number of people…

People

More answers like this

More with Dylan Patel

More with Dwarkesh Patel

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.