Smash Notes

Back to Investor Elad Gil’s next moves, with Elad Gil.

How Did Fifty People on One Problem Lead Companies to Buy Braintrust Three Months Later?

Many companies build internal tools for common problems like evaluation of large language models. The companies later decide to buy specialized software and redirect engineers to higher value work.

Braintrust offers an evaluation suite for enterprise customers. During early customer calls companies often said internal teams already worked on the problem so the companies did not need the product. The companies called back three months later. The companies then explained the internal team resources should go to something else because the work was not secret sauce. Fifty people worked on one problem. The software covered the whole surface area in ways the companies never will. Three engineers should deploy somewhere else so the companies could use the software.

The approach allows companies to avoid building every customization across platforms and data sources.

Transcript

Investor Elad Gil’s next moves ·

From the transcript

Yeah, I mean, he may create the next Mailchimp, right? I don't know. So that, that's the question is, you know, where does, where does the innovation come from and where does scale come from? And in general, what you find, I mean, this happens all the time, right? Where say you do have an internal tools team building something for you. This, this happened with a company that I helped out with quite early called Braintrust, where,

you know, they basically provide like a e, eval suite for enterprise amongst a bunch of other stuff, right? They have sort of a, a series of products now about what they kind of started with was, can we help make eval really easy as you adopt a LLM so that you can change the model and you can see what are, how do those changes propagate in terms of performance relative to some tests that you have? And,

See in transcript

The Next New Thing

More from this episode

  1. How Do Coding Models Let Millions Build the Next Minecraft?Small things sometimes become giant things because people often underestimate total addressable market or the number of people who want something.
  2. How Did Brain Co Cut Permit Waits to One Hour?Brain Co has built a common platform with data infra and evals then builds vertical specific apps for extremely large enterprises or very large institutions.
  3. How Did Incentives Raise Kids' Attention Deficit Diagnoses?A shift in incentives combined with changes in diagnostic definitions drives ADHD diagnoses to about three percent of kids.
  4. Why Does Artificial Intelligence Remain Interesting for the Next Decade Plus?Technology waves are non-obvious until they are obvious.
  5. Why Do Giants Ignore Opportunities Looking Too Small?Incumbents wake up late to new markets. Founders locate gaps large enough to reach scale before competition arrives from giants.

People

More answers like this

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.