Tristan Harris

Now, this shouldn't make you very comfortable.

You would think that with a technology this powerful and this uncontrollable, that we would be releasing it with the most wisdom and the most discernment that we ever have of any technology.

but we're currently caught in a race to roll out because the incentives are the more shortcuts you take to get market dominance or prove you have the latest capabilities, the more money you can raise and the more ahead you are in the race.

And we're seeing whistleblowers at AI companies forfeit millions of dollars of stock options in order to warn the public about what's at stake if we don't do something about it.

Even DeepSeq's recent success was in part based on capabilities that it was optimizing for by not actually focusing on protecting people from certain downsides.

So just to summarize, we're currently releasing the most powerful, inscrutable, uncontrollable technology we've ever invented

that's already demonstrating behaviors of self-preservation and deception that we only saw in science fiction movies.

We're releasing it faster than we've released any other technology in history and with under the maximum incentive to cut corners on safety.

And we're doing this so that we can get to utopia?

There's a word for what we're doing right now.

This is insane.

This is insane.

Now, how many people in this room feel comfortable with this outcome?

How many of you feel uncomfortable with this outcome?

I see almost everyone's hands up.

Do you think that if you're someone who's in China or in France or in the Middle East, and you're part of building AI, that if you were exposed to the same set of facts, do you think you would feel any differently than anyone in this room?

There's a universal human experience to something that is being threatened by the way that we're currently rolling this profound technology out into society.

So if this is crazy, why are we doing it?

Because people believe it's inevitable.

But is the current way that we're rolling out AI actually inevitable?