Back to Ryan Greenblatt – What happens once AI can automate AI research?, with Ryan Greenblatt.
What Happens Once AI Can Automate AI Research?
Ryan Greenblatt says once AIs roughly match the top human experts at AI research, the work can feed on itself. The models do the research, that produces smarter models, and the loop can pack a lot of progress into a short time. His median expectation is something like four or five years of AI progress in a single year. Getting there means overcoming a huge amount of diminishing returns and matching the kind of gain that would otherwise take a very large jump in compute.
AI research is an especially good place for that loop to start. Labs are already trying hard to make models good at it, and the work is pretty verifiable: you can iterate and climb on metrics. A bit over three years separated GPT-4 from Mythos 5, which he treats as already a huge jump. Five years would be closer to the distance from GPT-3 to Mythos 5.
Ryan Greenblatt – What happens once AI can automate AI research? ·
From the transcript
Whether or not this turns out to be the case, I think is actually probably the most important question in the world right now. Historically, I've been quite skeptical that this kind of thing happens, but you seem to think that it might be plausible, and so I wanted to hear the case for it. Yeah. Let's talk about this. First, I think it's worth noting that AR&D is a type of task at which the AIs are especially good because both the companies are trying really hard to make their AIs good at AR&D and it's the kind of domain, it has a lot of nice properties from the perspective of how AI development works right now.
So it's like pretty verifiable. You can do a bunch of stuff iteratively and he'll climb on various metrics. And then I think once you have AIs, which are roughly matching the top human experts in AI R&D, that could sort of kick off a feedback loop where, you know, the AIs are doing AI research, that produces smarter AIs, that feeds back in.