Smash Notes

Back to Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again, with Rich Sutton & Khurram Javed.

Why Are Big AI Labs Stuck in a Local Minimum?

Khurram Javed says the big labs are stuck in a local minimum. A move toward the new algorithms will almost certainly look worse before it looks better. A different paradigm will not hit state-of-the-art performance on the first day. The labs are locked into a product, and the current paradigm still lets them keep scaling, so they cannot take a path where the results get worse first.

The new paradigm is a bet. It depends on hard technical problems that people who have worked on them for many years already consider doable, and those problems take a long time to think through. He also says he does not see research groups that even believe a much more efficient system is possible. A group that does not believe it will not work through the technical problems.

Transcript

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again ·

From the transcript

can be more efficient than that even now with the right algorithm. If we can be more efficient than that, then why aren't we? It's not like people just want to spend all their money, spend all our money. Sometimes it seems like they want to. Yeah. Doesn't it?

That's how they show they're real men, by using lots of energy. At least when I look at different research groups, I don't even see anyone believing in it's possible. And I think if you don't believe in it, you're just not going to work on the technical problems and work through them. Is it that it's not possible or it's that there's so much waste in the system? Like, which one is it? Is there someone who knows how to do it efficiently? And then there's 10 times the number of people in the same lab doing all these other things.

See in transcript

Training Data

More from this episode

  1. Are Large Language Models an Example of Rich Sutton's Bitter Lesson?Rich Sutton says large language models are both a positive and a negative example of The Bitter Lesson.
  2. Why Does Rich Sutton Call Synthetic Data a Big Mistake?Rich Sutton says synthetic data is not a general method that uses computation. He calls it a big mistake, and maybe the next big lesson.
  3. Why Does Rich Sutton Say Prior Knowledge and Learning Should Be Friends?Rich Sutton says prior knowledge and learning should be friends. The Bitter Lesson opens by saying there is no need for a conflict between them.
  4. Why Do LLM Assistants Stop Learning After Deployment?Rich Sutton says the popular language-model assistants are not learning from experience. Their weights never change.
  5. Why Don't Animals Learn by Supervised Learning?Rich Sutton says no animal learns by supervised learning, because nobody supplies examples of how its muscles should twitch, and muscle movement is the…
  6. What Is Rich Sutton's Alberta Plan?Rich Sutton says the Alberta Plan, which he laid out in 2022, turns broad ideas about AI into smaller chunks. The 12 steps are those chunks.
  7. What Is Continual Backprop?Rich Sutton says Continual Backprop is ordinary backprop that also keeps planting new units with fresh random weights.
  8. What Is Oak Lab's Biggest Ambition?Rich Sutton says Oak Lab's biggest ambition is a mind that stays coherent while it keeps changing.

People

More answers like this

More with Rich Sutton

More with Sonya Huang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.