Smash Notes

Back to The Programmable Data Center — Evan Conrad, SF Compute, with Evan Conrad.

What Is a Programmable Data Center?

Evan Conrad says a programmable data center is a data center SF Compute has virtualized, so a customer gets the control that used to come with owning the hardware. A feature already shipping lets that customer subdivide an InfiniBand fabric without asking anyone to redraw the lines. Many clouds hand over a single fabric and then require a call when the boundaries need to move. Redrawing them on the fly fits a market where clusters scale up and down.

The same release is meant to make the capacity usable for platform-as-a-service companies. The goal is to virtualize the rest of what ownership used to include. The last shift like that was the arrival of cloud computing.

Transcript

The Programmable Data Center — Evan Conrad, SF Compute ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. How Does GPU Compute Trading Deliver the Hardware?Evan Conrad says GPU compute trading delivers the machines, which futures markets call physical settlement. SF Compute began by trying to sublease a cluster.
  2. Why Is Next Month's Compute Capacity Easier to Sell?Evan Conrad says capacity that starts a month from now can be bought and sold all the time, so liquidity shows up easily.
  3. How Long Are GPU Clusters Financed?Evan Conrad says GPU clusters in the broader market are financed for three to five years, and the payments cover that period.
  4. Why Is Live GPU Inference Harder to Interrupt Than a Batch Job?Evan Conrad says live GPU inference is harder to interrupt than a batch job because live customers expect the service to stay online, while a batch job can…
  5. How Does a Healthy Compute Price Curve Work?Evan Conrad says a healthy compute price curve is a hump, and it can point either way depending on the buyer.

People

More answers like this

The other side

More with Shawn Wang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.