Smash Notes

Back to Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028, with Dylan Patel.

How Fast Is Frontier AI Labor Growing?

Dwarkesh Patel says the effective AI workforce at frontier labs is growing about 10 times a year, and one lab could hold more labor than the number of people on Earth by the end of the decade.

Compute at the frontier, in flop terms, is growing four or five times a year, while the compute needed for a given capability falls about three times a year. That is about a 10 times larger effective population each year. It matters less today because the systems cannot yet do full jobs. If the trend holds, OpenAI goes from about 10 million AI laborers this year to 100 million the next year and a billion the year after. Even if compute scaling slows, it does not take many more years before each company has more labor equivalents than there are people on Earth. That is plausible by the end of this decade, with most of the work output concentrated in the two labs that keep taking more of the world's compute.

Dylan Patel says the same 10 times yearly growth holds even without recursive self-improvement, once the models are competent remote workers, software engineers, or researchers. With recursive self-improvement the growth could be 100 times or 1,000 times a year, or a mix of smarter models and a larger population. He does not see a path where this stays spread out.

Transcript

Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028 ·

From the transcript

One thing I find crazy about these scenarios is just how much of the world's future labor supply ends up in

very few companies. And also how fast that labor supply grows year over year. So if like, computer the frontier, you know, in flop terms is growing four or five X a year. And further, the computer required to achieve the likability is like decreasing 3x a year. So the computer at the frontier, basically the effective AI population size at the frontier labs is increasing 10x year over year.

And so that doesn't really matter that much right now because AIs are not good enough to do full jobs or be like, as autonomous as people in their capacity to do work or pull off schemes or whatever. But if the current trend continues, you have a world where OpenAI goes from having, say, 10 million basically AI laborers this year to 100 million the next year to a billion the year after that.

See in transcript

Dwarkesh Podcast

More from this episode

  1. How Much Revenue Does Anthropic Make Per Megawatt?Dylan Patel says Anthropic's revenue has gone as high as $50 million per megawatt, while the base cost of compute runs around $10, $13, or $15 million per…
  2. Will Anthropic and OpenAI Control Most AI Compute by 2028?Dylan Patel says Anthropic and OpenAI are on track to control most of the usable compute in the world by the end of 2028, and he sees nothing that stops the…
  3. Why Can't AI Labs Fund Next Year's Buildout?Dylan Patel says the labs can spend hundreds of billions of dollars and will generate hundreds of billions of revenue next year, but capital spending next…
  4. What Must AI Labs Pay Per Megawatt in 2028?Dylan Patel says the labs will keep buying a larger share of the world's compute, but they cannot do it at today's prices or anywhere close.
  5. Who Captures the Value That AI Models Create?Dylan Patel says most of the value these models create does not go to OpenAI or Anthropic. So far it goes mostly to the users.
  6. Will AI Labs Shift More Compute Into Training?Dylan Patel believes the labs will allocate less and less compute to inference over time and ratchet up the share dedicated to training.
  7. How Much AI Compute Will the World Have by 2028?Dylan Patel agrees that adding his yearly figures puts world AI compute over 200 gigawatts by the end of 2028, and he confirms that total is global.
  8. How Much AI Compute Will China Have by 2028?Dylan Patel says China will have about 30 gigawatts of AI compute or less in 2028, and China's share of new data-center compute stays under 10 percent.
  9. How Much Power Does Anthropic's Mythos Pre-train Use?Dylan Patel says Anthropic's Mythos pre-train uses under 200 megawatts for about two months, even while Anthropic is nearly five gigawatts by the end of the…
  10. Why Can't an AI Release Ban Stop a Singularity?Dylan Patel's main worry is a singularity that a public release ban fails to stop, because outside deployment is what is helping.

People

More answers like this

More with Dylan Patel

More with Dwarkesh Patel

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.