Smash Notes

Back to Managing AI Coding Costs at Scale.

How Many Jobs Has Patrick Wendell Had?

Patrick Wendell has had one job in his career. He was in graduate school at UC Berkeley in 2013, working where machine learning met big data, and then left with a few colleagues to start Databricks.

The group was scaling up classic machine learning, at a time when deep learning was not yet common, and the research sat tightly with very large data sets. If they just kept scaling, a lot of the work started to perform better, a small early version of the scaling laws happening now. They left to start Databricks, which is still around, at first around open source technology built for large-scale data and machine learning. As a founder he does not have a single role, but the day job is engineering and supporting several engineering teams.

In the last few years the same role has centered on how Databricks uses AI inside the company. For a company of that size, he thinks the internal adoption was pretty early and quite ambitious, and he has been the person most responsible for the effort. Databricks has thousands of engineers, and the aim is to give everyone AI tools and get them to be super productive.

Grokipedia·Databricks

Transcript

Managing AI Coding Costs at Scale ·

Software Engineering Daily

More from this episode

  1. Do Cheaper Models Match Frontier Models on Routine Coding?Patrick Wendell says much lower-cost models, even the last generation, perform identically to a very expensive frontier model on routine coding tasks like a…
  2. Why Do Teams Stay on the Expensive AI Model?Patrick Wendell says people are bad at judging which AI model is good enough for a task.
  3. Why Does Databricks Sandbox Its Coding Agents?Patrick Wendell sandboxes coding agents at Databricks so a model that takes an unsafe shortcut cannot easily call the open internet from a development…

More answers like this

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.