Smash Notes
David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience

Training Data

David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience

David Silver spent two years building AlphaGo on human data. When he removed human data altogether building AlphaGo Zero, the AI surpassed AlphaGo in under two days. He left DeepMind to run that same bet in pursuit of superintelligence. David and Lasse Espeholt, co-founders of Ineffable Intelligence, explain their plan to build a “superlearner”—an agent…

People

Notes

  1. What Surprised David Silver About Tiny Extra Data? at 2:03

    David Silver says the right approach to solve AI is learning from experience, through systems that discover things for themselves. Full answer

  2. What Is Ineffable's Super Learner? at 9:50

    David Silver says a super learner has incredible capacity in depth and in breadth. Full answer

  3. Why Did a Second Agent Make Go Endless? at 24:21

    David Silver says a game of Go with one agent is the most boring game you could imagine, and a second agent turns the board into emergent complexity with an… Full answer

  4. Was AlphaGo Zero a Coin Flip for David Silver? at 27:31

    David Silver says he was about 50-50 on whether removing human priors would produce even smarter intelligence. Full answer

  5. How Fast Did AlphaZero Overtake Two Years of AlphaGo? at 30:15

    David Silver says the moment the team let go of human data, AlphaZero outperformed two years of human-in-the-loop AlphaGo work in a few hours. Full answer

  6. Why Does David Silver Believe a Super Learner Will Work? at 33:57

    David Silver strongly believes the approach behind a super learner will be feasible at some point. Full answer

  7. Why Will Simulation Build Superintelligence Faster? at 38:13

    Sonya Huang asked where the ceiling on simulation sits and when an agent should enter the real world. Full answer

  8. Why Does Ineffable Pace the Real World but Rush Simulation? at 51:03

    Sonya Huang asked about pacing the frontier. Full answer

  9. How Did Lasse Espeholt's DeepMind Agent Get So Popular? at 58:16

    Lasse Espeholt built a reinforcement learning agent at DeepMind that utilized GPUs and scaled linearly with compute. Full answer

  10. Why Did Ineffable Keep the Team Small? at 1:01:07

    Ineffable has hired 20 people and is keeping the team small on purpose. Full answer

Related notes

Related episodes

Plays from this note through the rest of the episode.

Note

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.