Smash Notes

Back to Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics, with Jason Ma.

How Can a Robot Work Alone for an Hour?

Jason Ma says a robot can work alone for an hour when a hierarchical agent harness sits around the world-action model and strings short skills into one workflow. People plan a job in steps, notice one part is finished, and move on while something else is still running. A low-level model that only outputs the next motion would have to learn all of that reasoning at once, which is extremely inefficient.

The laundry task makes the split concrete. The washer is running, so the robot should go do something else until the cycle finishes. When the washer is done, the robot should take the towels from the wash and put them in the dryer immediately, or the wait becomes a bottleneck in the whole workflow. The harness lets the world-action model compose different skills into the longer job.

Language models made the same jump. Two years ago and three years ago they were mainly autocomplete, and a person had to keep tapping to get more code. An agentic system now carries a task from end to end. Robotics still often treats autonomy as a one-minute or 30-second task. The value is workflows that run unsupervised for hours, so the problem is a whole system: a good agent, a good harness, a good model, and good hardware.

Transcript

Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. What Is a World-action Model?Jason Ma says a world-action model predicts the future video of the world and also turns that prediction into actions a robot can execute.
  2. Why Does Dyna 2 Use a Diffusion Transformer?Jason Ma says the Dyna 2 world action model is a diffusion transformer.
  3. How Does Dyna Robotics Generate Synthetic Robot Data?Jason Ma says his team generates synthetic robot data with frontier models that build synthetic environments and with a world action model that makes its own…
  4. Why Must a Robot Model Run on the Device?Jason Ma says a robot model has to run on the device because the robot must infer fast enough to act. A language model or a coding agent can wait.
  5. Why Does Dyna Robotics Size Robots Like People?Jason Ma says the robot's proportions are measured against real people because the team pre-trains on human data and treats the match as the transfer path…
  6. What Is a Semi-humanoid Robot?Jason Ma describes the robot as a semi-humanoid: the upper body is like a humanoid, and the lower body is wheels.
  7. Why Does the Dyna Robot Lean Its Torso?Jason Ma gave the Dyna robot a torso that can lean because people use the waist and back for ordinary tasks, and a body that only travels up and down cannot…
  8. What Limits Hour-long Robot Jobs?Jason Ma says the bottleneck for doing an hour-long full job on any task is data and hardware.
  9. Why Did Din Tai Fung Put Robots in Many Restaurants?Jason Ma says Din Tai Fung put Dyna robots in many United States restaurants because the chain decided the robots create enough value to roll out across…
  10. Why Did People Think AI Would Never Solve Go?Jason Ma thinks people, before AlphaGo, treated Go as one of the games that AI would never solve, because the search space is larger than the total number of…

People

More answers like this

More with Jason Ma

More with Shawn Wang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.