Why Did Coinbase Fine-tune a Small Model?
at 1:14:43
Answer
David Sacks says Brian Armstrong posted, the day before Anthropic's blog, that Coinbase had fine-tuned an open-weight model with 9 billion parameters. In testing it cut fraudulent transactions by about 30 percent, and it was faster and cheaper than Opus 4.5. Nine billion parameters is small. It will not fit in a Roomba, and it will run on a home computer.
Sacks says a lot of enterprise work does not need a frontier model. It needs a small specialist trained on the company's own data, so the company keeps the model. As compute gets tighter, a smaller model squeezes more work from each GPU. His read is that every workload gets its own customized model and uses a fraction of the compute and the energy. Small models are also the safe ones. They lack the capability the scare stories describe, which is why he calls the timing of the campaign against them suspicious.
Where this answer comes from
- Show
- All-In
- Episode
- CoreWeave Crash, AI Trade Cracks, Anthropic IPO Red Flags, Bill Gates Doomer
- People
- Ben Horowitz, Chamath Palihapitiya, Jason Calacanis, David Sacks, David Friedberg
- Moment
- Date
People
On this episode
- Why Did CoreWeave Bonds Crush the Cloud Stocks? Transcript
- How Does CoreWeave's Box Pay the Bills? Transcript
- What Default Odds Did CoreWeave's Swaps Imply? Transcript
- How Close Is CoreWeave to Its Breakeven? Transcript
- Why Did Ben Horowitz Pass on Neoclouds? Transcript
- Is the CoreWeave Crash Just Market Volatility? Transcript
- Why Is Demand for Software Coders Still Rising? Transcript
- What Leaked From Anthropic's Investor Day? Transcript
- Why Does Ben Horowitz Own Both AI Labs? Transcript
- Does David Sacks Expect a Strong Anthropic IPO? Transcript
- Why Should Anthropic Raise $200 Billion Now? Transcript
- How Did Anthropic Stop Distillation Without Washington? Transcript
- Why Did Coinbase Fine-tune a Small Model? Transcript
- Why Is Anthropic Training Models to Refuse People? Transcript
- Why Is Bill Gates the Doomer on Artificial Intelligence? Transcript
- Why Did Bill Gates Retire to Be Loved? Transcript
More answers like this
- How Did Anthropic Stop Distillation Without Washington?
- Why Is Anthropic Training Models to Refuse People?
- Why Should Anthropic Raise $200 Billion Now?
- Why Is Bill Gates the Doomer on Artificial Intelligence?
- Why Do Most AI Startups Use Open Models?
More with Ben Horowitz
More with Chamath Palihapitiya
- Why Does Chamath Palihapitiya Say Software Intellectual Property Was Rendered Worthless?
- Why Does Chamath Palihapitiya Say France's Bonds Force Cuts?
- Why Does the Claude Constitution Train Claude to Refuse Anthropic?
- How Do You Find Ideas That Make a Lot of Money
- When Is the Next Crash Going to Happen
- Who Got Rich and Who Got Stuck in Silicon Valley?
Related episodes
- COVID-19 & Impact on Startups, Venture Capital & Public Markets
- COVID-19 Political, Economic & Social Ramifications
- E291: Trump's Super Intelligence Summit, AI Safety Accord, GDP Beats, Midterm Predictions
- Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots
- Chamath Palihapitiya: People in Silicon Valley are deeply unhappy
- Jason Calacanis
- Ben Affleck on “Animals,” Matt Damon, and His Family
- Investor Elad Gil’s next moves