Smash Notes

Back to The Programmable Data Center — Evan Conrad, SF Compute, with Evan Conrad.

How Does GPU Compute Trading Deliver the Hardware?

Evan Conrad says GPU compute trading delivers the machines, which futures markets call physical settlement. SF Compute began by trying to sublease a cluster. Selling that capacity was like offering a hotel room, then being asked to clean it, then to run room service, then security, until the seller was running the whole hotel. At that point the supplier looks more like a fund or a cloud that already has the data center. The company spent several years building the operating capacity of a cloud so the compute actually arrives and stays reliable.

In oil or soybeans, physical settlement means the goods show up. Oil needs pipelines. During COVID, oil went negative: a holder stuck with barrels in port would pay someone to take them. Power markets put a similar limit in the order book, because a boiler takes time to cool and to start again. Compute has the same kind of constraint. A buyer might accept an interruption only when storage is there so the job can recover quickly.

SF Compute co-designed physical settlement and the order book so those real limits sit in the market, instead of treating every GPU hour as interchangeable.

Transcript

The Programmable Data Center — Evan Conrad, SF Compute ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. Why Is Next Month's Compute Capacity Easier to Sell?Evan Conrad says capacity that starts a month from now can be bought and sold all the time, so liquidity shows up easily.
  2. How Long Are GPU Clusters Financed?Evan Conrad says GPU clusters in the broader market are financed for three to five years, and the payments cover that period.
  3. Why Is Live GPU Inference Harder to Interrupt Than a Batch Job?Evan Conrad says live GPU inference is harder to interrupt than a batch job because live customers expect the service to stay online, while a batch job can…
  4. How Does a Healthy Compute Price Curve Work?Evan Conrad says a healthy compute price curve is a hump, and it can point either way depending on the buyer.
  5. What Is a Programmable Data Center?Evan Conrad says a programmable data center is a data center SF Compute has virtualized, so a customer gets the control that used to come with owning the…

People

More answers like this

The other side

More with Shawn Wang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.