Smash Notes

Back to The $2B AI Startup Simulating Human Behavior with 85% Accuracy, with Joon Sung Park.

Why Does Predicting Behavior Fail to Show What to Do?

Joon Sung Park says a forecast is not what people came for. A warning that a market will crash in two quarters does not help unless the aim is to beat the stock market. The next question is what to do now, and a correlation cannot supply that lever.

Asking the right questions matters. The interview idea came in 2023 and 2024, during podcasts about academic work at Stanford. After an hour or two, a good interviewer who asks the right questions knows a tremendous amount about a field and a person. Questions are both topical and general, and asking someone to tell the story of their life reveals pockets of knowledge. Behavior data is collected too, including transaction data and mobility data.

What matters is the cause, through randomized trials. The same setup changes one variable, a product feature or a message, and records how behavior changes. Understanding that cause is what can shift the direction of the future.

Transcript

The $2B AI Startup Simulating Human Behavior with 85% Accuracy ·

Sourcery

More from this episode

  1. Why Do We Live in a Simulation?Joon Sung Park thinks we live in a simulation because any civilization will recreate itself to understand itself.
  2. What Was the Smallville AI Experiment?Joon Sung Park ran Smallville in 2022 and 2023 to see whether a language model could simulate a whole person, then a whole town.
  3. How Did Simile's Digital Twins Reach 85% Accuracy?Joon Sung Park says agents built as digital twins of real people predicted behavior with 85% or better accuracy by the end of 2024.
  4. When Is a Simile Simulation Confident Enough to Act on?Joon Sung Park says an AI simulation of a person is strong enough for a very high-stakes decision when confidence is higher than 90 percent, and usually when…
  5. Why Did Winning Electric Vehicle Messaging Lower Sales?Joon Sung Park says a message that looked like a clear winner for a new electric vehicle also shifted how people saw non-electric vehicles and lowered sales…
  6. Are Universal Basic Income Simulations Worth Running?Joon Sung Park calls universal basic income simulations good ones to run.
  7. Is AI Behavior Simulation in Its GPT-4 Era?Joon Sung Park says AI behavior simulation is in its GPT-4 and GPT-4.5 era.
  8. Why Doesn't a Buyout Offer End Simile?Joon Sung Park says a $15 billion offer to sell Simile does not end the work when he has every reason to believe an ambitious idea exists that only Simile can…

People

More answers like this

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.