Back to Ryan Greenblatt – What happens once AI can automate AI research?, with Ryan Greenblatt.
Do AI Skills Transfer Past Verifiable Tasks?
Ryan Greenblatt says the open question is how well skill transfers from getting good at understanding a situation, getting up to speed, and making progress in verifiable domains, over to jobs like convincing a president or being put in charge of Google and making the company more profitable this quarter. Models are getting much better, very fast, at the verifiable side.
Some data can still be gathered on the hard-to-verify side, including a bit of training on whether humans thought an essay was good, plus online training from real-world results. In practice the transfer looks okay to him. Models have improved a lot on domains that are hard to verify, and it is hard to point to a hard-to-verify domain where the jump from GPT-4 to Mythos has not been pretty high. That does not mean Mythos is better than the best humans. It can still be significantly worse than a typical professional at some part of the job while being far ahead of GPT-4.
Ryan Greenblatt – What happens once AI can automate AI research? ·
From the transcript
Similarly, there's a broader skill of quickly understanding context and being able to have a bunch of different AIs learn in parallel and then merging that together. I think there seems to be a crux here, which I think is just an empirical question we'll see on, which is how good is a transfer between getting really good at
understanding the situation, getting up to speed, making progress over long periods in verifiable domains, which the AIs are obviously getting way, way better at really fast. Two, okay, go talk to the president and convince him to do X thing, or you're now in charge of Google and now you must make Google a much more profitable company this quarter.
Let me try to just spell out a few more arguments that are maybe relevant. One thing is that I do think that when looking at how the AIs have improved essay writing, Let's talk about that a little bit. I think there's one thing which is that you can get some data even on these domains, and AIs will be able to get some data even on these domains when on a very fast progress trajectory.