Smash Notes

Back to Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again, with Rich Sutton & Khurram Javed.

Are Large Language Models an Example of Rich Sutton's Bitter Lesson?

Rich Sutton says large language models are both a positive and a negative example of The Bitter Lesson. They scaled with computation by taking in the internet, and that produced a much more capable system. The internet is finite, the world is massively bigger than everything stored there, and leaning on that stock of human knowledge eventually holds the systems back.

The essay is not a ban on fancy algorithms. He wants algorithms that scale with computation, such as search and learning, rather than methods that scale with human input. He wrote it from decades of watching the field, including the symbolic AI era, get distracted by putting human knowledge in. He had given versions of the talk at least a year before the 2019 essay. It was not a reaction to the language-model moment.

Transcript

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again ·

From the transcript

Yeah, you're making me think about X now. I recently made a post where I tried to do the bitter lesson in 26 words. It goes something like, don't be distracted by human knowledge

as AI traditionally has been many times. Instead, focus on learning methods that will scale with computation like search and like learning. So it's really all about focusing on algorithms and improvements. It's not saying you don't need fancy algorithms. You need fancy algorithms, but you want fancy algorithms that will scale with computation.

Rather than scaling with data. Rather than scaling with human input. Yeah, and then the question, if I can anticipate it, yeah, what about large language models? Are they- Consistent or inconsistent with your essay? Yeah, and I've thought about this, and I think there's another ex post about it, but The conclusion is that it's both a positive example and a negative example of the bitter lesson.

See in transcript

Training Data

More from this episode

  1. Why Does Rich Sutton Call Synthetic Data a Big Mistake?Rich Sutton says synthetic data is not a general method that uses computation. He calls it a big mistake, and maybe the next big lesson.
  2. Why Does Rich Sutton Say Prior Knowledge and Learning Should Be Friends?Rich Sutton says prior knowledge and learning should be friends. The Bitter Lesson opens by saying there is no need for a conflict between them.
  3. Why Do LLM Assistants Stop Learning After Deployment?Rich Sutton says the popular language-model assistants are not learning from experience. Their weights never change.
  4. Why Don't Animals Learn by Supervised Learning?Rich Sutton says no animal learns by supervised learning, because nobody supplies examples of how its muscles should twitch, and muscle movement is the…
  5. What Is Rich Sutton's Alberta Plan?Rich Sutton says the Alberta Plan, which he laid out in 2022, turns broad ideas about AI into smaller chunks. The 12 steps are those chunks.
  6. What Is Continual Backprop?Rich Sutton says Continual Backprop is ordinary backprop that also keeps planting new units with fresh random weights.
  7. What Is Oak Lab's Biggest Ambition?Rich Sutton says Oak Lab's biggest ambition is a mind that stays coherent while it keeps changing.
  8. Why Are Big AI Labs Stuck in a Local Minimum?Khurram Javed says the big labs are stuck in a local minimum. A move toward the new algorithms will almost certainly look worse before it looks better.

People

More answers like this

The other side

More with Rich Sutton

More with Sonya Huang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.