What Is the Riskiest Next Phase of AI?

Demis Hassabis says the next phase of AI carries the most risk: closed RSI, a closed loop without the human reviewer process. The closed loop will obviously be faster, and it is also a very dangerous way to get to full AGI.

A lot of the cyber issues from the last six months could have been addressed with better engineering and more robust engineering. The human is still very much in the loop.

Leading labs generally agree on third party auditors or evaluators coming in. Which third parties should do the work is still an open question, and a healthy ecosystem is needed. Good startups and companies could take on the work. There is enough revenue for them, given the amount of investment going into AI as a whole.