Smash Notes

Back to Inside the Robot Data Factory: Mecka's Josh Gao on Sensorizing Humans to Train Robots, with Josh Gao.

What Does Teaching Robots About Carbon Life Mean?

Josh Gao says teaching robots about carbon life means showing them what organic life is made of, once robots can do the tasks people do. He wrote that line on the Mecka website himself, the night before the first public announcement, or something close to that night.

The picture is from science fiction. When robotics and AI have generalized every task humans can do, the frontier that remains is organic, and it is biological. He points to Asimov and to Ender's Game. At the end of The Hitchhiker's Guide to the Galaxy, the planet is a giant organic computer trying to work out the meaning of life, or the question. He puts the human brain in the same frame. It runs on 20 watts, and people are self-healing.

That is the website line in short form. Along the path to robots that generalize, the work is to show them what carbon life is made of.

Grokipedia·Ender

Transcript

Inside the Robot Data Factory: Mecka's Josh Gao on Sensorizing Humans to Train Robots ·

Training Data

More from this episode

  1. What Is Egocentric Data for Training Robots?Josh Gao says egocentric data is video of humans demonstrating and doing tasks from a first person point of view.
  2. Why Put Sensors on People to Train Robots?Josh Gao says Mecka puts sensors on people because a robot has to learn how hard to squeeze, and video does not capture that force.
  3. What Does It Take to Run a Robot Data Factory?Josh Gao says running a robot data factory is more painful than a camera and a signup form, because much of the hardware sent into the world did not exist…
  4. Why Is Robot Data Still Far Behind Tesla's Driving Data?Josh Gao says robot training data is still many orders of magnitude behind the video Tesla collected for driving.
  5. What Will the First Robot Tasks Look Like?Josh Gao says the first robot tasks will be much more constrained and goal-oriented, jobs a team can hill-climb because a standard operating procedure already…
  6. Can Useful Robots Already Be Deployed Today?Josh Gao says useful robots can already be deployed today, and people underestimate how diverse robotics already is.
  7. How Many Hours of Human Data Do Robots Need?Josh Gao says the robot-training recipe coming together looks like a million hours of human data across egocentric capture and other modalities, tens of…

People

More answers like this

More with Sonya Huang

Related episodes

Plays from this note through the rest of the episode.

Note

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.