Why Did a Second Agent Make Go Endless?
David Silver says a game of Go with one agent is the most boring game you could imagine, and a second agent turns the board into emergent complexity with an endless learning curve. One agent only places stones until the grid is full, and there is no strategy whatsoever. The moment a second agent enters, one agent has to reason about all the possible behaviors of the other, and the complexity of the environment rises sharply.
Go is a 19 by 19 grid where the aim is to maximize territory. David Silver says that, to the best of their knowledge, the compute they sank into Go while they were working on it still left an endless learning curve. They could continue to discover new things in the game without end. He says Go is not an end point. The game remains a board game and quite narrow. Even so, very simple environment dynamics lead to an infinite onion of layers of complexity that never stops, infinite only to the capacity of what computers can do.
David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience ·
From the transcript
Yeah. Like the end goal is to have something that is grounded in the real world. Right. But stepping stones. I want to come back to the Go example because I really like this example. You'll be surprised to hear that I find Go a pretty good example.
But what I find fascinating, which I think is what Lass is talking to here, is that, you know, Go is just like a 19 by 19 grid where you're trying to kind of maximize the territory. And if this was a single agent game, it would be like the most boring game you could imagine. It would be, you know, you just place down stones on a grid until you fill up the whole grid.
And there'll be no strategy whatsoever. The moment you put a second agent into the environment, you get this emergent complexity, which is suddenly because the agent contains like one agent has to reason about all the possible behaviors of the other agent. And suddenly it kind of massively increases the complexity of the environment. And to the best of our knowledge, you know, certainly all of the compute which we sank into it when we were working on it, there was just like this endless learning curve that where without end, you could continue to discover new things in this game.