Smash Notes

Back to Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again, with Rich Sutton & Khurram Javed.

Why Don't Animals Learn by Supervised Learning?

Rich Sutton says no animal learns by supervised learning, because nobody supplies examples of how its muscles should twitch, and muscle movement is the animal's output. School is a tiny fraction of what people learn, and even in school nobody says how to move the mouth to pronounce a word. Squirrels do not go to school. He treats school as a recent human invention, not the essence of intelligence, and he takes animal learning as inspiration rather than a requirement that an AI copy babies.

Khurram Javed gives the speech test. If he moved his mouth, tongue, and vocal cords exactly the way Rich Sutton does when he says Paris, a different sound would come out. No one else knows the right movement for his body. Only he knows that. Copying another person's example cannot supply it.

Grokipedia·Paris

Transcript

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again ·

From the transcript

Where do you think we should most seek to draw inspiration from the way that biological learning works that is not present in today's systems? I feel like I'm just giving opinions now, but they're just obvious opinions. So I think it's apparent that no animal learns by supervised learning.

Because we don't get examples of how our muscles should twitch. And that's our output. But all of school is supervised learning. I know, absolutely not. But even if it was, school is like a tiny fraction of what we learn. Like we learn to see and we learn to walk and we learn how the world works. But even in school, no one tells us how we should twitch our muscles.

The knowledge skills I acquire were from supervised learning in school. I don't want to say that learning from others, transmission from others, is not important. It's extremely important. And language is extremely important. But what are we missing?

See in transcript

Training Data

More from this episode

  1. Are Large Language Models an Example of Rich Sutton's Bitter Lesson?Rich Sutton says large language models are both a positive and a negative example of The Bitter Lesson.
  2. Why Does Rich Sutton Call Synthetic Data a Big Mistake?Rich Sutton says synthetic data is not a general method that uses computation. He calls it a big mistake, and maybe the next big lesson.
  3. Why Does Rich Sutton Say Prior Knowledge and Learning Should Be Friends?Rich Sutton says prior knowledge and learning should be friends. The Bitter Lesson opens by saying there is no need for a conflict between them.
  4. Why Do LLM Assistants Stop Learning After Deployment?Rich Sutton says the popular language-model assistants are not learning from experience. Their weights never change.
  5. What Is Rich Sutton's Alberta Plan?Rich Sutton says the Alberta Plan, which he laid out in 2022, turns broad ideas about AI into smaller chunks. The 12 steps are those chunks.
  6. What Is Continual Backprop?Rich Sutton says Continual Backprop is ordinary backprop that also keeps planting new units with fresh random weights.
  7. What Is Oak Lab's Biggest Ambition?Rich Sutton says Oak Lab's biggest ambition is a mind that stays coherent while it keeps changing.
  8. Why Are Big AI Labs Stuck in a Local Minimum?Khurram Javed says the big labs are stuck in a local minimum. A move toward the new algorithms will almost certainly look worse before it looks better.

People

More answers like this

More with Rich Sutton

More with Sonya Huang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.