Smash Notes

Back to Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028, with Dylan Patel.

What Must AI Labs Pay Per Megawatt in 2028?

Dylan Patel says the labs will keep buying a larger share of the world's compute, but they cannot do it at today's prices or anywhere close.

Anyone can already make money at 10 to 15 million dollars per megawatt. A GB300 rack, downloaded weights, and a listing on Open Router can bring in more than the compute costs, so that price has started to rise. To reach about 100 gigawatts combined in 2028 and take about 70 percent of the world's compute, the labs have to pay 25, 30, or 50 million dollars a megawatt. He calls that 100 gigawatt goal very aggressive.

Rules the labs argue for are slowing them more than they slow open-source Chinese models. OpenAI has not released Astra and stopped training for two weeks. Anthropic has not released the system a safety assessment called Model 2, widely believed to be the next Mythos. If revenue per megawatt stalls, the ability to outbid everyone else fades, and the labs maybe cannot reach 100 gigawatts. Where safety does not matter, they could generate 100 million dollars per megawatt or more and pay 50 million a megawatt.

Transcript

Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028 ·

From the transcript

But ultimately, in 2028, if they get to 100 gigawatts combined, they have done

really disruptive things to the market. Because anyone can make money off of $10 to $15 million per megawatt compute today. You literally, like, I kid you not, it's not that hard. Go get a GB300 rack. Go download the Kimi weights. Go download VLM or SGLang. Set it up. You know, Codex and Fable can actually help you do this. It's pretty simple.

I mean, it's not like it's It's not trivial, but it's not like rocket science. And go put it on open router. It's very simple. And you'll start generating more revenue than you're paying for the compute. And so this has sort of already led to this compute pricing $10 to $15 million per megawatt start to inflect up. And to get to that 100 gigawatts in 2028, you have to believe...

See in transcript

Dwarkesh Podcast

More from this episode

  1. How Much Revenue Does Anthropic Make Per Megawatt?Dylan Patel says Anthropic's revenue has gone as high as $50 million per megawatt, while the base cost of compute runs around $10, $13, or $15 million per…
  2. Will Anthropic and OpenAI Control Most AI Compute by 2028?Dylan Patel says Anthropic and OpenAI are on track to control most of the usable compute in the world by the end of 2028, and he sees nothing that stops the…
  3. Why Can't AI Labs Fund Next Year's Buildout?Dylan Patel says the labs can spend hundreds of billions of dollars and will generate hundreds of billions of revenue next year, but capital spending next…
  4. Who Captures the Value That AI Models Create?Dylan Patel says most of the value these models create does not go to OpenAI or Anthropic. So far it goes mostly to the users.
  5. Will AI Labs Shift More Compute Into Training?Dylan Patel believes the labs will allocate less and less compute to inference over time and ratchet up the share dedicated to training.
  6. How Much AI Compute Will the World Have by 2028?Dylan Patel agrees that adding his yearly figures puts world AI compute over 200 gigawatts by the end of 2028, and he confirms that total is global.
  7. How Much AI Compute Will China Have by 2028?Dylan Patel says China will have about 30 gigawatts of AI compute or less in 2028, and China's share of new data-center compute stays under 10 percent.
  8. How Much Power Does Anthropic's Mythos Pre-train Use?Dylan Patel says Anthropic's Mythos pre-train uses under 200 megawatts for about two months, even while Anthropic is nearly five gigawatts by the end of the…
  9. Why Can't an AI Release Ban Stop a Singularity?Dylan Patel's main worry is a singularity that a public release ban fails to stop, because outside deployment is what is helping.
  10. How Fast Is Frontier AI Labor Growing?Dwarkesh Patel says the effective AI workforce at frontier labs is growing about 10 times a year, and one lab could hold more labor than the number of people…

People

More answers like this

The other side

More with Dylan Patel

More with Dwarkesh Patel

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.