Back to Cliff Sosin - Owning the Complements to Intelligence, with Cliff Sosin.
When Does AI Reach Its Limit?
Cliff Sosin says the limit arrives after the papers are finished. Models read all the papers and figure out connections that a person who had read all three papers and thought about them would have seen, though nobody had. All kinds of great results fall out of the reading. At some point the mining of published work is done, and what is left is a hypothesis about how to think about things outside what people already know. Even a super smart model will not necessarily be better at guessing the hypothesis. The model will still guess better than the smartest person, but the smartest person's odds are super low anyway.
The model can come up with great ideas for experiments, and the experiments will be worth doing. Having to run them is what limits the ability to expand. A sharper guess than the smartest person still has to be tested before knowledge moves past what the papers already contain.
Cliff Sosin - Owning the Complements to Intelligence ·
From the transcript
I started out by saying you need to touch reality to answer questions. And so if you had a model and it was going to think more about physics, it could certainly think lots of interesting thoughts about physics, but eventually it's going to need to do experiments. And that's not to say we couldn't also do experiments, but now we're bound by our ability to physically do experiments.
And so I think there's going to be this incredible time where there's going to be so many cool discoveries, which we're already starting to read about, where this paper was written, and this paper was written, and this paper was written. And if somebody had read all three papers and thought about it, they would have realized this, but nobody had.