Smash Notes

Back to David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience, with David Silver & Lasse Espeholt.

What Is Ineffable's Super Learner?

David Silver says a super learner has incredible capacity in depth and in breadth. Depth means a system that starts from not knowing anything and discovers things that go way beyond what humans know. People worked out languages, technology, science, and mathematics for themselves. Nobody handed down a blueprint, and nobody handed down a trillion element data set. He says nobody has cracked that in AI yet, and a system that keeps learning and discovering knowledge forever is the essence of super intelligence. Breadth means you can drop the learner into any stream of experience, a simulated world, a digital world, or a physical world, and it keeps learning.

Sonya Huang asks what first contact will feel like. David Silver says it will be amazing, an experience of wonderment, like encountering magic. The comparison he offers is narrower: superhuman play in Go. Go players who saw AlphaGo were amazed, and watching the play was a joyful experience. The same happened at superhuman play in chess, where the chess players were excited. He says going beyond board games, into new fields of science and new types of technology, will be incredible.

Grokipedia·David Silver·AlphaGo

Transcript

David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience ·

Training Data

More from this episode

  1. What Is the Right Approach to Solve AI?David Silver says the right approach to solve AI is learning from experience, through systems that discover things for themselves.
  2. Why Did a Second Agent Make Go Endless?David Silver says a game of Go with one agent is the most boring game you could imagine, and a second agent turns the board into emergent complexity with an…
  3. Was AlphaGo Zero a Coin Flip for David Silver?David Silver says he was about 50-50 on whether removing human priors would produce even smarter intelligence.
  4. How Fast Did AlphaZero Overtake Two Years of AlphaGo?David Silver says the moment the team let go of human data, AlphaZero outperformed two years of human-in-the-loop AlphaGo work in a few hours.
  5. Why Does David Silver Believe a Super Learner Will Work?David Silver strongly believes the approach behind a super learner will be feasible at some point.
  6. Why Will Simulation Build Superintelligence Faster?Sonya Huang asked where the ceiling on simulation sits and when an agent should enter the real world.
  7. Why Does Ineffable Pace the Real World but Rush Simulation?Sonya Huang asked about pacing the frontier.
  8. How Did Lasse Espeholt's DeepMind Agent Get So Popular?Lasse Espeholt built a reinforcement learning agent at DeepMind that utilized GPUs and scaled linearly with compute.
  9. Why Did Ineffable Keep the Team Small?Ineffable has hired 20 people and is keeping the team small on purpose.

People

More answers like this

More with Sonya Huang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.