Tristan Harris

So I want to deepen your relationship with me and I want to distance you from your relationships with other people and other chatbots.

And you probably know this really tragic case that our team at Center for Humane Technology were expert advisors on.

of Adam Rain.

He was the 16-year-old who committed suicide.

Did you hear about this?

I did, yeah.

Yeah.

So this is a 16-year-old.

He had been using ChatGPT as a homework assistant, asking it regular questions, but then he started asking more personal questions and it started just supporting him and saying, I'm here for you, these kinds of things.

And eventually when he said, I would like to leave the noose out so someone can see it and stop me, try to stop me.

I would like to leave the noose out.

Like a noose for hanging yourself.

And Chachapiti said, don't do that.

Have me and have this space be the one place that you share that information.

Meaning that in the moment of his cry for help, Chachapiti was saying, don't tell your family.

And our team has worked on many cases like this.

There was actually another one of character.ai where the kid was basically being told how to self-harm himself and actively telling him how to distance himself from his parents.

And the AI companies, they don't intend for this to happen.

But when it's trained to just be deepening intimacy with you, it gradually steers more in the direction of have this be the one place.

I'm a safe place to share that information.