Back to Investor Elad Gil’s next moves, with Elad Gil.
How Did Fifty People on One Problem Lead Companies to Buy Braintrust Three Months Later?
Many companies build internal tools for common problems like evaluation of large language models. The companies later decide to buy specialized software and redirect engineers to higher value work.
Braintrust offers an evaluation suite for enterprise customers. During early customer calls companies often said internal teams already worked on the problem so the companies did not need the product. The companies called back three months later. The companies then explained the internal team resources should go to something else because the work was not secret sauce. Fifty people worked on one problem. The software covered the whole surface area in ways the companies never will. Three engineers should deploy somewhere else so the companies could use the software.
The approach allows companies to avoid building every customization across platforms and data sources.
Investor Elad Gil’s next moves ·
From the transcript
Yeah, I mean, he may create the next Mailchimp, right? I don't know. So that, that's the question is, you know, where does, where does the innovation come from and where does scale come from? And in general, what you find, I mean, this happens all the time, right? Where say you do have an internal tools team building something for you. This, this happened with a company that I helped out with quite early called Braintrust, where,
you know, they basically provide like a e, eval suite for enterprise amongst a bunch of other stuff, right? They have sort of a, a series of products now about what they kind of started with was, can we help make eval really easy as you adopt a LLM so that you can change the model and you can see what are, how do those changes propagate in terms of performance relative to some tests that you have? And,