Tristan Harris

Or it'll put more fingers on the hands than are in the deep fake photo or something like that.

And I think that one thing that we have to do, what Helen Toner, who is a board member of OpenAI, calls AI jaggedness, that we have simultaneously AIs that are beating and getting gold on the International Math Olympiad, that are solving new physics, that are beating programming competitions and are better than the top 200 programmers in the whole world, or in the top 200 programmers in the whole world, that are beating cyber hacking competitions.

It's both supremely outperforming humans

And embarrassingly failing in places where humans would never fail.

So how does our mind integrate those two pictures?

Have you ever met Sam Altman?

I think that these people on some level all care about humanity.

Underneath, there is a care for humanity.

I think that this situation, this particular technology, it justifies humanity.

lacking empathy for what would happen to everyone because I have this other side of the equation that demands infinitely more importance, right?

Like, if I didn't do it, then someone else is going to build the thing that ends civilization.

So it's like, do you see what I'm saying?

It's not, it's, I can justify it as I'm a good guy.

And what if I get the utopia?

What if we get lucky and I got the aligned, controllable AI that creates abundance for everyone else?

If in that case, I would be the hero.

So this is the fundamental thing.

I want you to notice this.

Most people having heard everything we just shared, although we probably should build out the blackmail examples first, we have to reckon with evidence that we have now that we didn't have even like six months ago, which is evidence that when you put AIs in a situation, you tell the AI model, we're going to replace you with another model.

It will copy its own code and try to preserve itself on another computer.