Smash Notes

Back to Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again, with Rich Sutton & Khurram Javed.

Why Does Rich Sutton Say Prior Knowledge and Learning Should Be Friends?

Rich Sutton says prior knowledge and learning should be friends. The Bitter Lesson opens by saying there is no need for a conflict between them. You can put some prior in and then start learning. There is no reason in principle the two have to be opposed. Both are about knowledge. Life is gaining knowledge and having knowledge. Prior learning is what you already have, and then you learn more. Once you have gotten more, that becomes the prior. In practice the two have been enemies, because people who favored existing human knowledge wanted that knowledge to win and wanted learning dismissed.

AlphaGo and AlphaZero made him happy and made him feel vindicated. It could have gone either way, because prior knowledge can help. There is nothing wrong with prior knowledge. He is interested in the mind, which has prior knowledge and then gets more, and the two work together. He looks like someone who loves learning and wants to dismiss prior knowledge only because the rest of the world keeps saying all you need is enough knowledge.

Grokipedia·AlphaZero

Transcript

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again ·

From the transcript

But the only thing that matters in the long run is the leveraging of computation. And if I, you know, your former student Dave, with AlphaGo and AlphaZero, for me, that was an example of a triumph of removing human priors. Did that result surprise you? I guess, why or why not? Of course, it made me very happy. It made me feel vindicated. It

could have gone either way. It wasn't that, because prior knowledge can help. There's nothing wrong with prior knowledge. And I say this right at the very beginning of the bitter lesson. I say, there's no reason why there has to be a conflict between prior knowledge and then learning knowledge. You can put some prior in there and then start learning.

There's no reason in principle why these have to be opposed. In fact, they're all about knowledge. Life is gaining knowledge and having knowledge. And why are these... How somehow nature and nurture became enemies, but really... You know, prior learning is what you already, and then you learn more. And they should be friends. But as I say at the beginning of the bitter lesson, in practice, they have been enemies.

See in transcript

Training Data

More from this episode

  1. Are Large Language Models an Example of Rich Sutton's Bitter Lesson?Rich Sutton says large language models are both a positive and a negative example of The Bitter Lesson.
  2. Why Does Rich Sutton Call Synthetic Data a Big Mistake?Rich Sutton says synthetic data is not a general method that uses computation. He calls it a big mistake, and maybe the next big lesson.
  3. Why Do LLM Assistants Stop Learning After Deployment?Rich Sutton says the popular language-model assistants are not learning from experience. Their weights never change.
  4. Why Don't Animals Learn by Supervised Learning?Rich Sutton says no animal learns by supervised learning, because nobody supplies examples of how its muscles should twitch, and muscle movement is the…
  5. What Is Rich Sutton's Alberta Plan?Rich Sutton says the Alberta Plan, which he laid out in 2022, turns broad ideas about AI into smaller chunks. The 12 steps are those chunks.
  6. What Is Continual Backprop?Rich Sutton says Continual Backprop is ordinary backprop that also keeps planting new units with fresh random weights.
  7. What Is Oak Lab's Biggest Ambition?Rich Sutton says Oak Lab's biggest ambition is a mind that stays coherent while it keeps changing.
  8. Why Are Big AI Labs Stuck in a Local Minimum?Khurram Javed says the big labs are stuck in a local minimum. A move toward the new algorithms will almost certainly look worse before it looks better.

People

More answers like this

More with Rich Sutton

More with Sonya Huang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.