Why Did a Second Agent Make Go Endless?
at 24:21
Answer
David Silver says a game of Go with one agent is the most boring game you could imagine, and a second agent turns the board into emergent complexity with an endless learning curve. One agent only places stones until the grid is full, and there is no strategy whatsoever. The moment a second agent enters, one agent has to reason about all the possible behaviors of the other, and the complexity of the environment rises sharply.
Go is a 19 by 19 grid where the aim is to maximize territory. David Silver says that, to the best of their knowledge, the compute they sank into Go while they were working on it still left an endless learning curve. They could continue to discover new things in the game without end. He says Go is not an end point. The game remains a board game and quite narrow. Even so, very simple environment dynamics lead to an infinite onion of layers of complexity that never stops, infinite only to the capacity of what computers can do.
Where this answer comes from
People
More notes from this episode
- What Surprised David Silver About Tiny Extra Data? Transcript
- What Is Ineffable's Super Learner? Transcript
- Why Did a Second Agent Make Go Endless? Transcript
- Was AlphaGo Zero a Coin Flip for David Silver? Transcript
- How Fast Did AlphaZero Overtake Two Years of AlphaGo? Transcript
- Why Does David Silver Believe a Super Learner Will Work? Transcript
- Why Will Simulation Build Superintelligence Faster? Transcript
- Why Does Ineffable Pace the Real World but Rush Simulation? Transcript
- How Did Lasse Espeholt's DeepMind Agent Get So Popular? Transcript
- Why Did Ineffable Keep the Team Small? Transcript
More answers like this
- What Is Ineffable's Super Learner?
- Was AlphaGo Zero a Coin Flip for David Silver?
- What Surprised David Silver About Tiny Extra Data?
- How Fast Did AlphaZero Overtake Two Years of AlphaGo?
- What Is Go, and How Does It Help With AI Research