Why Is AI Arms Control Unstable in a Close Race?

Leopold Aschenbrenner says an arms control agreement is very unstable when the race is close, because three months ahead is enough to win.

He says the incentive to race ahead and break out is enormous. The plan is to run the intelligence explosion, and if one side gets three months ahead, that side wins. Any arms control agreement reached while the race is close is, he says, very unstable. Dwarkesh Patel set the claim beside an argument for nuclear disarmament he had debated on his podcast. In that argument, a country that breaks out and starts developing nuclear weapons would leave about six months, enough time to build international consensus, invade, and stop the country from getting nuclear weapons. Dwarkesh Patel said he does not see a stable equilibrium there and that holding the line looks really tough. He added that artificial general intelligence might make a deal a bit easier, because one side can monitor the other side's cluster.

Leopold Aschenbrenner agreed. Data centers can be seen from space, and the energy draw they take can be seen as well. A dedicated observer, he said, has many ways to get information from the environment.