Smash Notes

Back to Can AI Keep Growing Exponentially? Let’s Ask SemiAnalysis — With Dylan Patel and Jordan Nanos, with Dylan Patel & Jordan Nanos.

Why Do So Many Neoclouds Fail ClusterMax?

Jordan Nanos says most neoclouds still miss the ClusterMax bar because a seller's market rewards raising money, building data centers, and deploying chips faster than improving the service. Almost two years after the first ClusterMax, and after Semi Analysis coined the term neocloud, many providers have not moved toward what their customers already ask for.

Semi Analysis tracks 323 providers in the Cloud TCO model. Only some are large enough to matter, and fewer pass a recommendation bar that is quite low. The two top failures are security and reliability, and both are dead simple. Companies can still run great businesses without a service customers enjoy and recommend to other people.

Only so many providers can lead, because only so many people truly innovate and everybody else copies them. People who represent buyers find it sad how little progress has shown up since ClusterMax first appeared.

Transcript

Can AI Keep Growing Exponentially? Let’s Ask SemiAnalysis — With Dylan Patel and Jordan Nanos ·

From the transcript

Look, as people who are trying to represent the interests of buyers, I think it just makes us sad. It's sad to see that like a year and a half almost since the first version of ClusterMax was published, actually approaching two years now.

and since we coined the term neocloud at Semi Analysis, that a lot of people have just not made progress towards the things that we were writing about. And the things we were writing about is just exactly what we talk to the customers of these neoclouds about what they want.

And so I think it's just like the dynamic of it being a seller's market means that the priority for these companies is how can they raise as much money as they can, how can they build data centers as fast as they can, and how can they deploy chips as fast as they can, rather than working on the true quality of the underlying service. And that's a little bit of the dynamic that you see represented there, where people can have these great businesses without actually worrying too much about delivering a great service that their customers really enjoy and recommend to other people.

See in transcript

Big Technology Podcast

More from this episode

  1. How Big Is Next Year's AI Capital Spending?Dylan Patel says next year's capital spending for the AI build-out in the United States is on the order of $2 trillion.
  2. Can AI Infrastructure Spending Keep Growing Exponentially?Dylan Patel says AI capital spending cannot keep compounding at triple-digit rates from here. The build-out runs out of things to organize.
  3. How Much Revenue Does $1 Trillion of AI Data Center Spending Need?Dylan Patel says a trillion dollars spent today on an AI data center and GPUs needs about $1.5 trillion of revenue over six years if payback is a straight…
  4. Is Anthropic Profitable After Compute Costs?Dylan Patel says Anthropic is now profitable once revenue is set against compute cost, with training and inference combined.
  5. Will AI Replace Knowledge Work in the Next Few Years?Dylan Patel says AI will not replace knowledge work in the next few years.
  6. Can Hyperscalers Cancel Neocloud Contracts Each Month?Jordan Nanos says hyperscalers and large frontier labs signing neocloud contracts generally do not have a right to cancel every month and walk away.
  7. Could Anthropic Be Worth $10 Trillion?Dylan Patel says Anthropic could be the first company in the world with a $10 trillion valuation, and the bullish case also reaches $20 trillion.
  8. How Much Is Nvidia Backstopping Neoclouds?Jordan Nanos says SemiAnalysis is tracking $588 billion of off-balance-sheet backstops that Nvidia is supporting.
  9. Can Open-source Models Hack a Neocloud?Dylan Patel says most neoclouds have terrible security, and open-source models can hack one or reach other customers' data on it.
  10. Why Did Oracle's New Mexico AI Data Center Slip?Dylan Patel says Oracle's New Mexico data center slipped because the pipelines were not going to arrive, and the site cannot be built without them.
  11. Which AI Lab Has the Least Compute?Dylan Patel says DeepMind has the least compute of Anthropic, OpenAI, and DeepMind by the end of the year.
  12. Why Do AI Labs Keep Their Best Models Internal?Dylan Patel says frontier labs are keeping months of new-model progress inside the company, because once a model is public other people can distill it.

People

More answers like this

More with Dylan Patel

More with Alex Kantrowitz

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.