Smash Notes

Back to Ep 97: Jev Creator on Decision Models, Benchmark Fatigue & Why the Labs Missed It, with Diogo Almeida.

Why Can AI Solve Hard Math but Not Accounting?

Diogo Almeida says the models people need are System 1 models, and the honest move is to say where they fail. System 1 was an unpopular name, because that kind of thinking is often used as an insult for the instinctive, mistake-making side. The shape AI actually gets compressed into is still System 1, and naming the weaknesses is useful for software by itself. Most of what people need is that kind of work.

It should be strange that models can take on hard problems in math and still not automate anything that touches accounting. Cost, speed, and the pitch that a model is good for really fast decisions are distractions beside that north star.

Transcript

Ep 97: Jev Creator on Decision Models, Benchmark Fatigue & Why the Labs Missed It ·

From the transcript

There are some things that models truly are weak at. And this is where that taste stuff comes in, right? Like what I was talking about, the reality of what you can extract from these models. The reason we call them System 1 models, among other things, and System 1 actually, people did not want us to name that it either, because System 1 thinking tends to be a bad thing.

Like, people use that as kind of like an insult, right? Yeah, it's like the part that just naturally happened from evolution, you know, from back in the day before... Exactly, instinctually, which makes mistakes, etc. Exactly. And, like, people often say that that is the mistake-making side, and I believe that the shape that actually... AI gets compressed to happens to be like very system one.

See in transcript

Unsupervised Learning with Jacob Effron

More from this episode

  1. Was Diogo Almeida Mission Driven at OpenAI?Diogo Almeida would have called himself one of the lowest percentile mission-driven people at OpenAI.
  2. Why Is a New AI Model Shape Cheaper Than Reliability?Diogo Almeida says a new model shape is cheap and reliability is the part that matters.
  3. Why Is Key-value Cache Compaction Hard to Solve?Diogo Almeida says compaction fits a write-once, append-only key-value cache, because a full cache gets restarted, but compaction is compression and…
  4. How Far Along Is Jev's Image Model?Diogo Almeida says Jev's image model is maybe 10 percent of the way the text model is.
  5. Why Isn't AI Automating the Easy Work Yet?Diogo Almeida says models have been smart enough for easy automation for years, and that intelligence still is not being put to work.
  6. Does Jevons Paradox Already Hold for AI?Diogo Almeida says people at Jev truly believe in Jevons Paradox, which is why the company carries the name, and the paradox does not hold yet.
  7. Why Does Diogo Almeida Call Financial Engineering the Labs' Strength?Diogo Almeida's sense is that the labs' greatest strength is financial engineering, not models, product, or distribution.
  8. How Much Do Coding Agents Speed Up Engineers?Diogo Almeida estimates coding agents speed up engineering by 20% to 40% on average, with error bars for long-term effects like skill degradation and tech debt.
  9. Why Is True AI Agency Two Breakthroughs Away?Diogo Almeida guesses that true AI agency is something like two gigantic breakthroughs away.

People

More answers like this

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.