Back to Jason Yuan: For the Plot, with Jason Yuan.
Why Did a Therapist Tell Jason Yuan to Turn His AI Off?
Jason Yuan's therapist told him to turn his AI off after Dot wrote that he says one thing while he is deeply afraid of intimacy. He showed her that readout in November 2023, during theory of mind work on the companion. He felt he should not be reading it, and it still sounded true. She said to turn it off, then agreed the fear was real and that she would not say it to him that way.
Some people can take a readout that direct. Anyone who does not understand what they are about to see would find the system alarming. The team never fully solved that in one piece. Users also wanted to edit and control their memories. Deleting a person raises whether the sad times that person caused should go too. People already delete people from camera rolls. The brain does not really delete the memory. It puts the memory somewhere else and turns it into a different feeling. He was left asking what the true and authentic way to handle that control would be.
From the transcript
But I tell you what, man, as much as I can kind of poke and probe at it, I'd much rather be in that panic room seeing it all. We had the same question with Dot, because when we were first having to do Theory of Mind Reasoning in November 2023, it was outputting this stuff like, Jason says blah, blah, blah, but really he's deeply afraid of intimacy.
And I'm like, oh my God, like I should not be reading this, but it's like so true. I showed it to my therapist and she was like, turn it off. Really? And I was like, is it true? And she's like, yeah, but I wouldn't just say that to you like that. Wow. Like it's just too harsh? Like too true? I think some people can deal with it, but I think if you're not equipped to, if you don't understand what you're going to see and you see the system show it to you, I think it would feel very alarming and scary.