Back to Ryan Greenblatt – What happens once AI can automate AI research?, with Ryan Greenblatt.
What Is the Least Verifiable Part of AI Research?
Ryan Greenblatt says the least verifiable part of AI research is probably making calls on large experiments. Models are already strong in verifiable domains. The bottleneck is doing the actual work of big experiments, where there are only a few tries, and calling the number a few understates how many tries are available.
Historically, research and development has been driven by near-frontier-scale experiments and by the one big training run where someone decides exactly what to include. Models can make the choice more verifiable with better science for predicting results. They can also scale a frontier training run down so the same scale can be studied more aggressively, at a one-time hit to compute cost. Training smaller models lets people run more rounds.
Ryan Greenblatt – What happens once AI can automate AI research? ·
From the transcript
And again, both have the internet data. My sense is that the... current methods but without many human experts actually will do quite well. Though it's a bit messy because it's like can Mythos get something that's more capable than Mythos? You might need to be a bit thoughtful on what model is it that you're post-training. What is your view on what is the least verifiable part of AI R&D? The least verifiable, probably making calls on large experiments.
Like the thing that I think is most likely to be sort of the bottleneck in terms of like the AIs are really good at verifiable domains, but not doing the actual thing. It's just like big experiments. You only get a few tries. Well, a few is maybe a bit understated, but like basically like historically R&D has been driven by doing near frontier scale experiments.