Smash Notes

Back to 20VC: Horizontal vs Vertical Agents: Who Wins | Model Routing: Commodity or Increasing in Value | The Future of the Inference Market | Why Founders Should Take Discounts for Tier 1 Firms with Harrison Chase, LangChain, with Harrison Chase.

What Share of Engineering Salary Goes to Coding Tools?

Harrison Chase says they spend roughly 30% of engineering salary on coding tools. The share has gone down over the last two months, while the number of tokens used has gone up.

They did it in three steps. First, they tracked all coding agent usage in Langsmith so they could tell who was spending how much, what they were spending it on, and run analytics. Second, they set a budget. If someone hits the budget, they can talk to the VP of engineering, who almost always increases it. The budget is a safeguard against agents used incorrectly or stuck in a bad loop. Third, they control the harness. They built an in-house cloud coding agent called OpenSWE. People can still use whatever they want for an IDE or a terminal-based agent.

OpenSWE is the only way he codes anymore. He is in Slack all the time, so he messages it from Slack and it kicks off.

Grokipedia·Harrison Chase·LangSmith

Transcript

20VC: Horizontal vs Vertical Agents: Who Wins | Model Routing: Commodity or Increasing in Value | The Future of the Inference Market | Why Founders Should Take Discounts for Tier 1 Firms with Harrison Chase, LangChain ·

The Twenty Minute VC: Venture Capital | Startup Funding | The Pitch

More from this episode

  1. Should I Take a Sequoia and Benchmark Discount?Harrison Chase says it is absolutely worth taking a discount for Sequoia and Benchmark.
  2. What Is the Hardest Part of Building AI Agents?Harrison Chase says the hardest part of building agents is getting the system to behave reliably. Models are non-deterministic black boxes.
  3. Will Model Labs Eat the Agent Harness?Harrison Chase says the agent harness should stay neutral, so the memory and context an agent builds are not locked to one model lab.
  4. Why Do Domain Experts Win With Vertical Agents?Harrison Chase says a founder should start a vertical agent at the harness layer, doing context engineering before any post-training of the model, because…
  5. Why Hasn't Anyone Solved AI Memory?Harrison Chase says the hardest part of AI memory is the intelligence that decides what to keep, not the database.
  6. What Kind of Agent Do Most Apps Need?Harrison Chase says most apps probably need a vertical agent of their own.
  7. Why Are AI Bills Rising Even as Models Get Cheaper?Harrison Chase says AI bills rise because agents burn far more tokens, even while frontier models get cheaper on price for performance.
  8. Should Companies Fear Open Source Chinese Models?Harrison Chase does not think fear of open source Chinese models is justified. Some enterprises are fearful of working with open source Chinese models.
  9. Should Founders Discount for Sequoia and Benchmark?Harrison Chase says taking money from Benchmark changes a company's trajectory completely, and a discount is absolutely worth it for Sequoia and for Benchmark.

People

More answers like this

More with Harry Stebbings

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.