Smash Notes

Back to Bringing Continual Learning to Every Company: Trajectory’s Ronak Malde, with Ronak Malde & Pat Grady.

How Should Product Builders Shape Self-improving Products?

Ronak Malde says a product builder should take traces and experience from the real world and use them to shape and improve the product on its own. Trajectory is starting with the model, and more work remains there. Eventually both the model and the harness self-improve. As products become more native to AI, the harness becomes most of the product for a lot of companies. The right to self-improve the harness and then the product is the right to improve and self-improve the entire company.

Products and product builders then become almost like a gardener with a plant that grows on its own. The builder sets trellises in the ground to mark where the product should be shaped. A product can go out to a couple of hundred users and grow on its own. The builder imbues taste into where the company grows. He calls that a very exciting world, and companies should start building toward it.

Transcript

Bringing Continual Learning to Every Company: Trajectory’s Ronak Malde ·

Training Data

More from this episode

  1. What Is Continual Learning?Ronak Malde tells Pat Grady and Lauren Reeder that the human brain is the model for real continual learning.
  2. How Did Harvey Train a Cheaper Legal Model?Ronak Malde says Harvey trained its own model on a legal agent benchmark built from expert data the company already holds, and that model came out six times…
  3. What Is GRPO?Ronak Malde says GRPO is the main post-training algorithm right now. Picture a player hopping across platforms in a video game and getting a reward at the end.
  4. Why Don't Language Models Learn From Experience?Ronak Malde says language models do a task and never accumulate experience or learn anything about the real world.
  5. What Is Recursive Self-improvement?Ronak Malde says research is heading toward recursive self-improvement and continual learning, two close ways for an agent to learn from experience.

People

More answers like this

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.