Smash Notes

Back to Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics, with Jason Ma.

Why Did People Think AI Would Never Solve Go?

Jason Ma thinks people, before AlphaGo, treated Go as one of the games that AI would never solve, because the search space is larger than the total number of atoms in the world. Reinforcement learning cracked it anyway, and that is how he got into AI.

He spent time in Japan and China as a kid and grew up playing Go. AlphaGo came out when he was a senior in high school. He had played for many years and was mind blown that a game he found so complicated fell to reinforcement learning. He wanted models, systems, and agents that can self-improve. At Penn as a PhD student he worked on reinforcement learning, co-advised by advisors who were both interested in it. One advisor focused more on robotics and had done a postdoc at Berkeley Robotics Lab, which is how he got into robots at Penn. He thinks Grasp is one of the best places to do robotics, and the PhD became reinforcement learning for robotics.

Grokipedia·AlphaGo·Japan

Transcript

Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. What Is a World-action Model?Jason Ma says a world-action model predicts the future video of the world and also turns that prediction into actions a robot can execute.
  2. Why Does Dyna 2 Use a Diffusion Transformer?Jason Ma says the Dyna 2 world action model is a diffusion transformer.
  3. How Does Dyna Robotics Generate Synthetic Robot Data?Jason Ma says his team generates synthetic robot data with frontier models that build synthetic environments and with a world action model that makes its own…
  4. Why Must a Robot Model Run on the Device?Jason Ma says a robot model has to run on the device because the robot must infer fast enough to act. A language model or a coding agent can wait.
  5. Why Does Dyna Robotics Size Robots Like People?Jason Ma says the robot's proportions are measured against real people because the team pre-trains on human data and treats the match as the transfer path…
  6. What Is a Semi-humanoid Robot?Jason Ma describes the robot as a semi-humanoid: the upper body is like a humanoid, and the lower body is wheels.
  7. Why Does the Dyna Robot Lean Its Torso?Jason Ma gave the Dyna robot a torso that can lean because people use the waist and back for ordinary tasks, and a body that only travels up and down cannot…
  8. What Limits Hour-long Robot Jobs?Jason Ma says the bottleneck for doing an hour-long full job on any task is data and hardware.
  9. Why Did Din Tai Fung Put Robots in Many Restaurants?Jason Ma says Din Tai Fung put Dyna robots in many United States restaurants because the chain decided the robots create enough value to roll out across…
  10. How Can a Robot Work Alone for an Hour?Jason Ma says a robot can work alone for an hour when a hierarchical agent harness sits around the world-action model and strings short skills into one…

People

More answers like this

More with Jason Ma

More with Shawn Wang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.