Smash Notes

Back to The Programmable Data Center — Evan Conrad, SF Compute, with Evan Conrad.

How Long Are GPU Clusters Financed?

Evan Conrad says GPU clusters in the broader market are financed for three to five years, and the payments cover that period. On the SF Compute order book, a block of capacity can run for any length of time. A buyer can take the next hour, the stretch from right now to the next hour, or the stretch from right now out to three years, and any span in between. Five years is available technically.

A block is paid entirely upfront. A longer-term lease is not. The cash flow on those longer blocks still needs more work. The priority is capacity further out, because the goal is a forwards curve with a lot of liquidity.

Transcript

The Programmable Data Center — Evan Conrad, SF Compute ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. How Does GPU Compute Trading Deliver the Hardware?Evan Conrad says GPU compute trading delivers the machines, which futures markets call physical settlement. SF Compute began by trying to sublease a cluster.
  2. Why Is Next Month's Compute Capacity Easier to Sell?Evan Conrad says capacity that starts a month from now can be bought and sold all the time, so liquidity shows up easily.
  3. Why Is Live GPU Inference Harder to Interrupt Than a Batch Job?Evan Conrad says live GPU inference is harder to interrupt than a batch job because live customers expect the service to stay online, while a batch job can…
  4. How Does a Healthy Compute Price Curve Work?Evan Conrad says a healthy compute price curve is a hump, and it can point either way depending on the buyer.
  5. What Is a Programmable Data Center?Evan Conrad says a programmable data center is a data center SF Compute has virtualized, so a customer gets the control that used to come with owning the…

People

More answers like this

More with Shawn Wang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.