Smash Notes

Back to Ep 97: Jev Creator on Decision Models, Benchmark Fatigue & Why the Labs Missed It, with Diogo Almeida.

Why Does Diogo Almeida Call Financial Engineering the Labs' Strength?

Diogo Almeida's sense is that the labs' greatest strength is financial engineering, not models, product, or distribution. As far as he has heard, veterans talk about structuring deals so the lab is protected while other people take the risk of latching onto the rocket ship and accepting the terms. Asked whether that is about compute, he says it shows up on all sorts of sides, and especially on compute.

He does not know how tangled the deals are, or how exposed a lab would be if the market turned. A bubble can pop because expectations are missed, even when the technology is transformative. He has no private information, tries to stay calibrated, and calls himself the more conservative person in the argument.

Transcript

Ep 97: Jev Creator on Decision Models, Benchmark Fatigue & Why the Labs Missed It ·

From the transcript

And I think that the flatlining revenue might be indicative of that people are realizing that maybe they spent too much. So from a product perspective, I think that there will be better experts than me at that. I actually get the sense that the greatest strength of the labs is not models or product or distribution, but financial engineering.

this is the thing that everyone who's like very veteran at the labs always talks about where my understanding is they structure these deals in incredibly beneficial ways to not fuck themselves over but fuck other people over who are taking the risk and trying to like latch on to the rocket ship and are willing to like accept whatever terms that would...

On the compute side? Yes, on all sorts of sides, but especially compute. I think that financial engineering, as far as I've heard, is their greatest strength. And I have no idea how much of a rat's nest that is and how vulnerable they would be to any which direction of the market going. You know, like a bubble can pop just because expectations are not met, not because it's not truly a transformative technology.

See in transcript

Unsupervised Learning with Jacob Effron

More from this episode

  1. Was Diogo Almeida Mission Driven at OpenAI?Diogo Almeida would have called himself one of the lowest percentile mission-driven people at OpenAI.
  2. Why Can AI Solve Hard Math but Not Accounting?Diogo Almeida says the models people need are System 1 models, and the honest move is to say where they fail.
  3. Why Is a New AI Model Shape Cheaper Than Reliability?Diogo Almeida says a new model shape is cheap and reliability is the part that matters.
  4. Why Is Key-value Cache Compaction Hard to Solve?Diogo Almeida says compaction fits a write-once, append-only key-value cache, because a full cache gets restarted, but compaction is compression and…
  5. How Far Along Is Jev's Image Model?Diogo Almeida says Jev's image model is maybe 10 percent of the way the text model is.
  6. Why Isn't AI Automating the Easy Work Yet?Diogo Almeida says models have been smart enough for easy automation for years, and that intelligence still is not being put to work.
  7. Does Jevons Paradox Already Hold for AI?Diogo Almeida says people at Jev truly believe in Jevons Paradox, which is why the company carries the name, and the paradox does not hold yet.
  8. How Much Do Coding Agents Speed Up Engineers?Diogo Almeida estimates coding agents speed up engineering by 20% to 40% on average, with error bars for long-term effects like skill degradation and tech debt.
  9. Why Is True AI Agency Two Breakthroughs Away?Diogo Almeida guesses that true AI agency is something like two gigantic breakthroughs away.

People

More answers like this

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.