Back to Ryan Greenblatt – What happens once AI can automate AI research?, with Ryan Greenblatt.
Can AI Match a Good Machine Learning Researcher?
Ryan Greenblatt says current models can already match humans who are mediocre at machine learning research, and that is not very helpful. The researchers you actually want are good at the work. Taste and intuition are improving and are already not complete garbage. He expects more transfer than a savant picture: models that are pretty good scientists in general, incredibly superhuman at writing kernels and at anything with a very short feedback loop, and pretty good at the rest.
Researchers in 2022 who were trying to crack reasoning would have gone faster if an experiment could run as soon as they thought of it, without bugs mattering so much. High compute also lets a lab paper over an implementation that is not quite right, or the wrong hyperparameters. A large increase in labor would still help, especially if that labor came with some of the best intuition in the field.
Ryan Greenblatt – What happens once AI can automate AI research? ·
From the transcript
reasoning and it was just that they were bottlenecked by the ability to write infrastructure code or what was happening? It's a complicated mix. So I think that they would have gone faster if they could, as soon as they thought of an experiment, run that experiment without bugs, without bugs being very important. Then I think another part of it is that being able to run a lot of experiments at high compute lets you paper over ways in which the way you implemented it isn't quite right or you didn't have the right hyperparameters.
And so I think compute is just like really helpful for doing AI research. And you can like, you know, cover over a lot of things. But that doesn't mean that massive increases in labor wouldn't also be helpful, especially if that labor comes with, you know, among the best intuitions that people have in the field. I just think that that's, you know, really helpful.