Was AlphaGo Zero a Coin Flip for David Silver?
at 27:31
Answer
David Silver says he was about 50-50 on whether removing human priors would produce even smarter intelligence. He likes research questions that sit on a knife edge. Work where he is already 95% certain of the answer feels boring, because good research asks something he is really not sure about in advance.
He was not confident, and seeing the result was exciting. Silver says they are making a bet: go further by giving up the priors everyone else relies on today, the human data and the whole internet of knowledge other systems are built on. The choice is a short-term sacrifice. They give up a certain amount of performance to reach something potentially far greater.
For Silver, a super learner needs full depth and full breadth. In the depth direction, it has to discover things so far beyond human knowledge that they sit beyond the prior. Leaning harder on human data leaves them less able to find the algorithms that discover a whole new field of knowledge. In the breadth direction, the algorithms have to be placed into environments where language and the human data they started with are just not a good fit.
Where this answer comes from
People
More notes from this episode
- What Surprised David Silver About Tiny Extra Data? Transcript
- What Is Ineffable's Super Learner? Transcript
- Why Did a Second Agent Make Go Endless? Transcript
- Was AlphaGo Zero a Coin Flip for David Silver? Transcript
- How Fast Did AlphaZero Overtake Two Years of AlphaGo? Transcript
- Why Does David Silver Believe a Super Learner Will Work? Transcript
- Why Will Simulation Build Superintelligence Faster? Transcript
- Why Does Ineffable Pace the Real World but Rush Simulation? Transcript
- How Did Lasse Espeholt's DeepMind Agent Get So Popular? Transcript
- Why Did Ineffable Keep the Team Small? Transcript
More answers like this
- Why Did a Second Agent Make Go Endless?
- How Fast Did AlphaZero Overtake Two Years of AlphaGo?
- What Is Ineffable's Super Learner?
- Why Does David Silver Believe a Super Learner Will Work?