Smash Notes

Back to Managing AI Coding Costs at Scale.

How Many Jobs Has Patrick Wendell Had?

Patrick Wendell has had one job in his career. He was in graduate school at UC Berkeley in 2013, working where machine learning met big data, and then left with a few colleagues to start Databricks.

The group was scaling up classic machine learning, at a time when deep learning was not yet common, and the research sat tightly with very large data sets. If they just kept scaling, a lot of the work started to perform better, a small early version of the scaling laws happening now. They left to start Databricks, which is still around, at first around open source technology built for large-scale data and machine learning. As a founder he does not have a single role, but the day job is engineering and supporting several engineering teams.

In the last few years the same role has centered on how Databricks uses AI inside the company. For a company of that size, he thinks the internal adoption was pretty early and quite ambitious, and he has been the person most responsible for the effort. Databricks has thousands of engineers, and the aim is to give everyone AI tools and get them to be super productive.

Grokipedia·Databricks

Transcript

Managing AI Coding Costs at Scale ·

From the transcript

Patrick, welcome to the show. Thank you so much for having me. I'm excited to be here. Yeah, I am excited to dig in. Well, let's start with a little bit of your background. So can you tell our audience a little bit about your background, how you ended up where you are today and in this conversation? Yeah, sounds great. So my career history is pretty simple because I've only really had one job in my career.

And that job is that I was in grad school at UC Berkeley in 2013. And a few of us that were working on, we were working at the intersection of machine learning, then machine learning, which was not really a lot of deep learning yet, but it was sort of scaling up classic ML. And we were looking at those problems. And then they were very tightly coupled with big data problems.

See in transcript

Software Engineering Daily

More from this episode

  1. Do Cheaper Models Match Frontier Models on Routine Coding?Patrick Wendell says much lower-cost models, even the last generation, perform identically to a very expensive frontier model on routine coding tasks like a…
  2. Why Do Teams Stay on the Expensive AI Model?Patrick Wendell says people are bad at judging which AI model is good enough for a task.
  3. Why Does Databricks Sandbox Its Coding Agents?Patrick Wendell sandboxes coding agents at Databricks so a model that takes an unsafe shortcut cannot easily call the open internet from a development…

More answers like this

The other side

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.