Why Don't Animals Learn by Supervised Learning?
Rich Sutton says no animal learns by supervised learning, because nobody supplies examples of how its muscles should twitch, and muscle movement is the animal's output. School is a tiny fraction of what people learn, and even in school nobody says how to move the mouth to pronounce a word. Squirrels do not go to school. He treats school as a recent human invention, not the essence of intelligence, and he takes animal learning as inspiration rather than a requirement that an AI copy babies.
Khurram Javed gives the speech test. If he moved his mouth, tongue, and vocal cords exactly the way Rich Sutton does when he says Paris, a different sound would come out. No one else knows the right movement for his body. Only he knows that. Copying another person's example cannot supply it.
Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again ·
From the transcript
Where do you think we should most seek to draw inspiration from the way that biological learning works that is not present in today's systems? I feel like I'm just giving opinions now, but they're just obvious opinions. So I think it's apparent that no animal learns by supervised learning.
Because we don't get examples of how our muscles should twitch. And that's our output. But all of school is supervised learning. I know, absolutely not. But even if it was, school is like a tiny fraction of what we learn. Like we learn to see and we learn to walk and we learn how the world works. But even in school, no one tells us how we should twitch our muscles.
The knowledge skills I acquire were from supervised learning in school. I don't want to say that learning from others, transmission from others, is not important. It's extremely important. And language is extremely important. But what are we missing?