Smash Notes

Back to Can AI Keep Growing Exponentially? Let’s Ask SemiAnalysis — With Dylan Patel and Jordan Nanos, with Dylan Patel & Jordan Nanos.

Can Hyperscalers Cancel Neocloud Contracts Each Month?

Jordan Nanos says hyperscalers and large frontier labs signing neocloud contracts generally do not have a right to cancel every month and walk away. They sign five-year and six-year terms, take the full capacity, and agree to a set hourly rate and a total contract value.

Neocloud providers find the terms attractive because they have already secured land and power, built a site, and in some cases purchased the chips before the contract. The potential to slow down, pause, or cancel that Dylan Patel described applies more to self-build sites. Meta has massive campuses meant as a base load of capacity going into the future, and Meta can buy chips for them or leave an empty shell for years.

Construction costs, while very expensive, are a small percentage of the total cost of a new chip project. Concrete, steel, and walls are important and hard to finish, but on a dollar basis the HBM, the optics, and the GPUs are the bigger portion of the bill.

Grokipedia·Dylan Patel

Transcript

Can AI Keep Growing Exponentially? Let’s Ask SemiAnalysis — With Dylan Patel and Jordan Nanos ·

Big Technology Podcast

More from this episode

  1. How Big Is Next Year's AI Capital Spending?Dylan Patel says next year's capital spending for the AI build-out in the United States is on the order of $2 trillion.
  2. Can AI Infrastructure Spending Keep Growing Exponentially?Dylan Patel says AI capital spending cannot keep compounding at triple-digit rates from here. The build-out runs out of things to organize.
  3. How Much Revenue Does $1 Trillion of AI Data Center Spending Need?Dylan Patel says a trillion dollars spent today on an AI data center and GPUs needs about $1.5 trillion of revenue over six years if payback is a straight…
  4. Is Anthropic Profitable After Compute Costs?Dylan Patel says Anthropic is now profitable once revenue is set against compute cost, with training and inference combined.
  5. Will AI Replace Knowledge Work in the Next Few Years?Dylan Patel says AI will not replace knowledge work in the next few years.
  6. Could Anthropic Be Worth $10 Trillion?Dylan Patel says Anthropic could be the first company in the world with a $10 trillion valuation, and the bullish case also reaches $20 trillion.
  7. How Much Is Nvidia Backstopping Neoclouds?Jordan Nanos says SemiAnalysis is tracking $588 billion of off-balance-sheet backstops that Nvidia is supporting.
  8. Can Open-source Models Hack a Neocloud?Dylan Patel says most neoclouds have terrible security, and open-source models can hack one or reach other customers' data on it.
  9. Why Did Oracle's New Mexico AI Data Center Slip?Dylan Patel says Oracle's New Mexico data center slipped because the pipelines were not going to arrive, and the site cannot be built without them.
  10. Why Do So Many Neoclouds Fail ClusterMax?Jordan Nanos says most neoclouds still miss the ClusterMax bar because a seller's market rewards raising money, building data centers, and deploying chips…
  11. Which AI Lab Has the Least Compute?Dylan Patel says DeepMind has the least compute of Anthropic, OpenAI, and DeepMind by the end of the year.
  12. Why Do AI Labs Keep Their Best Models Internal?Dylan Patel says frontier labs are keeping months of new-model progress inside the company, because once a model is public other people can distill it.

People

More answers like this

More with Alex Kantrowitz

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.