Back to Ryan Greenblatt – What happens once AI can automate AI research?, with Ryan Greenblatt.
Why Have Some Big AI Training Runs Failed?
Dwarkesh Patel frames the pattern as labs raising the count of active parameters more slowly than a naive scaling story would predict, so they can train smaller models and move faster. Ryan Greenblatt says the picture is a more complicated mix of factors. A bunch of big training runs have not gone that well. GPT-4.5 was famously a bit of a bust in the view of people at OpenAI, and he has heard rumors of other big runs that were a bit of a bust. A lot of the problem is getting the details right. It makes sense to do more of the work at smaller scale, accept a hit on final performance, and iterate faster so the lab learns more and ends up with a smarter production model.
Reinforcement learning also benefits more from small models, and that is not the only effect. Labs are making that trade toward faster iteration because algorithmic progress is moving so fast.
Ryan Greenblatt – What happens once AI can automate AI research? ·
From the transcript
but the token price is not increasing. And you're suggesting that we've like increased active parameters slower than you would have naively assumed because people just want to make fast progress on training models. And you do that by training smaller models faster. I mean, there's a complicated mix of factors. I think my view is more like people have done a bunch of big training runs that did not go that well.
So there's like GPD 4.5, which like... famously people at Opening Eye thought was a bit of a bust. I think there's some rumors that there were a bunch of other training runs that people have done that were a bit of a bust. And part of it is that I think there's just a bunch of details in actually getting that right. And so it makes sense to just do more of the work at smaller scale and just eat the fact that you're taking a hit on final performance in order to be able to quickly iterate and train more models faster and therefore better learn and also better...