Should Teams Use the Best AI Model First?
at 9:33
Answer
Nikesh Arora says that in the experimentation phase a company should use the best model it can find, in the easiest way. He says not to restrict the team, not to cost-optimize, and not to stitch a private stack yet.
Two teams at his company, twenty people rather than twenty thousand, have just discovered AI in the last twelve to eighteen months, and adoption is not fully diffused. Making the tools harder slows that down. Arora calls the easy-adoption stretch phase one. After that, different tasks need different models. Inspecting all traffic at an endpoint costs twenty dollars a year, or twenty to twenty-five dollars a year. Sending that traffic through a token-priced model is not practical. He says to compress a small language model, make it task specific, and train it until it reaches 99.9 percent accuracy.
A frontier model is for the rare case, such as an active breach whose business impact he puts in the billions of dollars. For most practical enterprise use, and for a defender model in peacetime, Arora says to take an open-weight model, train it on proprietary data, and manage the weights.
Where this answer comes from
People
More notes from this episode
- When Could a Quantum Computer Break Today's Encryption? Transcript
- Should Teams Use the Best AI Model First? Transcript
- How Often Are AI-found Code Flaws Real? Transcript
- Will Agent-written Code Beat Human-written Code? Transcript
- Will Every State Ban Data Centers? Transcript
- Why Will Enterprise Software Vendors Consolidate? Transcript
- Can AI Software Replace a Bank Lookup? Transcript
More answers like this
- When Could a Quantum Computer Break Today's Encryption?
- How Often Are AI-found Code Flaws Real?
- Will Agent-written Code Beat Human-written Code?
- Will Every State Ban Data Centers?
- Why Is Writing Code Almost Solved?
More with Chamath Palihapitiya
- Why Should Anthropic Raise $200 Billion Now?
- How Close Is CoreWeave to Its Breakeven?
- What Default Odds Did CoreWeave's Swaps Imply?
- Why Is Bill Gates the AI Doomer?
- Why Did CoreWeave Bonds Crush the Cloud Stocks?
- Is Software Intellectual Property Now Worthless?
More with Jason Calacanis
- Why Does Ben Horowitz Own Both AI Labs?
- What Leaked From Anthropic's Investor Day?
- Why Did Bill Gates Retire to Be Loved?
- Is the CoreWeave Crash Just Market Volatility?
- Did Jason Calacanis Want Lockdown Policy Judged by Its Side Effects?
- What Makes for a Healthy Work-life Balance
Related episodes
- CoreWeave Crash, AI Trade Cracks, Anthropic IPO Red Flags, Bill Gates Doomer
- COVID-19 & Impact on Startups, Venture Capital & Public Markets
- COVID-19 Political, Economic & Social Ramifications
- Dylan Field: Is AI Replacing Designers?, Design is the New Code & Democratizing Creativity
- E291: Trump's Super Intelligence Summit, AI Safety Accord, GDP Beats, Midterm Predictions
- Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots
- Is There an A.I. Bubble? A Debate.
- Perplexity CEO: SMBs Could Drive the Next Economic Boom