Tristan Harris

Let's do this in a safe way with a few players locking it down.

But that has a different set of failure modes of creating unprecedented concentrations of wealth and power locked up into a few companies.

One way to think about it is, who would you trust to have a million times more power and wealth than any other actor in society?

Any company?

Any government?

Any individual?

And so one of those end games is dystopia.

So these are two obviously undesirable probable outcomes of AI's rollout.

And those who want to focus on the benefits of open source don't want to think about the things that come from chaos.

And those who want to think about the benefits of safety and regulated AI control don't want to think about dystopia.

And so, obviously, these are both bad outcomes that no one wants.

And we should seek something like a narrow path where power is matched with responsibility at every level.

Now, that assumes that this power is controllable, because one of the unique things about AI is that the benefit is it can think for itself and make autonomous decisions.

That's one of the things that makes it so powerful.

And I used to be very skeptical when friends of mine who were in the AI community talked about the idea of AI scheming or lying.

But unfortunately, in the last few months, we are now seeing clear evidence of things that should be in the realm of science fiction actually happening in real life.

We're seeing clear evidence of many frontier AI models that will lie and scheme when they're told that they're about to be retrained or replaced and find a way maybe they should copy their own code outside the system.

We're seeing AIs think that when they will lose a game, that they will sometimes cheat in order to win the game.

We're seeing AI models that are unexpectedly attempting to modify its own code to extend their runtime.

So we don't just have a country of Nobel Prize geniuses in a data center, we have a million deceptive, power-seeking and unstable geniuses in a data center.