Smash Notes

Back to 20VC: Why Robotics Will be 100x Bigger than Coding Agents | Inference Will Be a $10TRN Market: What No One Sees | Why Software Investors are F***** Today with Naveen Rao, Unconventional, with Naveen Rao.

Why Are Big AI Model Companies a Data Problem?

Naveen Rao says the big AI model companies are largely a data problem. Most of their capabilities have not come from advances in the model itself.

The market specializes, and working on important problems creates a big market that is defensible. A power law applies to skills: humans can learn many skills, yet some skills are more valuable than others, and the same pattern holds for data and curricula. Data work started as a commodity, a volume gathering of observations. Higher-quality data sets, including higher quality for coding and for chain of thought, now carry a lot of value. A model is almost just a manifestation of what it learned.

The data layer stays important going forward. Building models and knowing how to choose data is the game right now, and that data layer does not commoditize.

Grokipedia·Naveen Rao

Transcript

20VC: Why Robotics Will be 100x Bigger than Coding Agents | Inference Will Be a $10TRN Market: What No One Sees | Why Software Investors are F***** Today with Naveen Rao, Unconventional ·

From the transcript

I mean, they're still astonishingly large, but in such short time. Naveen, you Dude, you're such a smart dude. It's such a joy talking to you. I just kind of want to ask you lots of questions about the world. What happens to this market? Does it just consolidate over time? Does it unbundle more and more and you build more defensibility? What happens? I think it specializes, to be honest.

And I think if you specialize and actually start to work on important problems, you have a big market that's defensible. You know, it's again, it's a power law for skills. You could argue that all humans are capable of learning many skills, but certain skills are more valuable than others. And the same thing will be true with data and curricula that you build, right? And so we see the specialization of data companies.

See in transcript

The Twenty Minute VC: Venture Capital | Startup Funding | The Pitch

More from this episode

  1. Have Physical Efficiency Gains in Chips Stopped?Naveen Rao says physical efficiency gains in chips have largely stopped.
  2. Should I Trust AI Agent Decisions Yet?Naveen Rao says people should not trust AI agent decisions as much as human decisions in a lot of cases just yet.
  3. Is Reinforcement Learning Less Efficient Per Dollar?Naveen Rao says reinforcement learning is more inefficient.
  4. Are Pure Software Investors in Trouble?Naveen Rao thinks hardware is the place to be over the next 10 years and is confident a pure software investor is in trouble.
  5. Why Does AI Leave Developer Budgets About the Same?Naveen Rao says the share of developer salary that shifts to coding tools may stay roughly stable, because training people to judge good code is the hard part.
  6. How Much Bigger Will Robotics Be Than Coding Agents?Naveen Rao thinks robotics is going to be 100 times larger than agentic coding.
  7. What Did Naveen Rao Change His Mind About?Naveen Rao changed his mind in the last 12 months on the useful metric for progress in investing. Market validation is an old way of looking at it.
  8. How Did Naveen Rao Feel Meeting Steve Jurvetson?Naveen Rao walked into an early meeting with Steve Jurvetson nervous. He had heard Jurvetson was super smart and expected to be taken apart.
  9. Why Is Naveen Rao Excited About AI?Naveen Rao is personally pumped that AI is a tool and capability for asking much bigger questions about the universe.

People

More answers like this

More with Harry Stebbings

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.