Back to ‘This Is Nuts.’ An OpenAI Insider Explains Why He Quit.
Why Did AI Tools Seem Worth Building?
Powerful tools could do a lot of good in the world on a day to day level. Something fundamentally smarter than we were seemed impossible to create. I thought that we were building powerful tools that could do a lot of good in the world on a day-to-day level, and I didn't think that we were going to be able to create something fundamentally smarter than we were.
‘This Is Nuts.’ An OpenAI Insider Explains Why He Quit. ·
From the transcript
I thought that we were building powerful tools that could do a lot of good in the world on a day-to-day level, and I didn't think that we were going to be able to create something fundamentally smarter than we were. And this is something I can say with full confidence only in hindsight, because it was only when this stopped being true, and when I thought, no, we really are going to have something that thinks circles around us, that I thought, oh, we're in a totally
inappropriate part of the possibility space here in terms of how safe the industry is actually being relative to that reality. It's one of these things, you know, people have said to me, they, you know, it must have been a hard decision or how brave of you or whatever. But when it became clear to me that we were going to build something, we, the industry, was on track to build something that could think circles around us, and we were this far from being ready for that at a safety and alignment level, it just became apparent to me that my time helping build it was over.