Smash Notes

Back to Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics, with Jason Ma.

Why Does the Dyna Robot Lean Its Torso?

Jason Ma gave the Dyna robot a torso that can lean because people use the waist and back for ordinary tasks, and a body that only travels up and down cannot match that motion. A couple of years ago he pulled a muscle while exercising. The next few days after a pulled muscle, or after sleeping in the wrong position, movement locks up and the neck gets very stiff. Daily life uses many muscles and degrees of freedom that stay invisible until one of them fails, and then tasks that usually feel natural turn awkward.

Reaching for a bottle works the same way. The arm does not act alone, and holding the upper body still on purpose feels strange. People move the torso all the time without thinking about it. A robot built to learn from human data needs the same freedom so the model can take in the motion and control the body. Without a lean, the transfer gets weaker, and the robot gets less dexterous and more awkward.

The new robot was ready not long ago, so it has much less data than the stationary arms. The model had not seen the new robot in pre-training, yet a pre-trained model learned the demo tasks very quickly. Pre-training on humans started before the hardware was ready, because the robots were going to be like people. The training side moved ahead while the hardware caught up, and the transfer is there and very helpful.

Transcript

Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. What Is a World-action Model?Jason Ma says a world-action model predicts the future video of the world and also turns that prediction into actions a robot can execute.
  2. Why Does Dyna 2 Use a Diffusion Transformer?Jason Ma says the Dyna 2 world action model is a diffusion transformer.
  3. How Does Dyna Robotics Generate Synthetic Robot Data?Jason Ma says his team generates synthetic robot data with frontier models that build synthetic environments and with a world action model that makes its own…
  4. Why Must a Robot Model Run on the Device?Jason Ma says a robot model has to run on the device because the robot must infer fast enough to act. A language model or a coding agent can wait.
  5. Why Does Dyna Robotics Size Robots Like People?Jason Ma says the robot's proportions are measured against real people because the team pre-trains on human data and treats the match as the transfer path…
  6. What Is a Semi-humanoid Robot?Jason Ma describes the robot as a semi-humanoid: the upper body is like a humanoid, and the lower body is wheels.
  7. What Limits Hour-long Robot Jobs?Jason Ma says the bottleneck for doing an hour-long full job on any task is data and hardware.
  8. Why Did Din Tai Fung Put Robots in Many Restaurants?Jason Ma says Din Tai Fung put Dyna robots in many United States restaurants because the chain decided the robots create enough value to roll out across…
  9. How Can a Robot Work Alone for an Hour?Jason Ma says a robot can work alone for an hour when a hierarchical agent harness sits around the world-action model and strings short skills into one…
  10. Why Did People Think AI Would Never Solve Go?Jason Ma thinks people, before AlphaGo, treated Go as one of the games that AI would never solve, because the search space is larger than the total number of…

People

More answers like this

More with Jason Ma

More with Shawn Wang

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.