Nick Bostrom

Because then you have this...

Because then you have this...

very powerful optimizing force in the world that is steering and strategizing and scheming to try to achieve some future outcome that is one where maybe there is no place for humans or where some human values are eliminated.

very powerful optimizing force in the world that is steering and strategizing and scheming to try to achieve some future outcome that is one where maybe there is no place for humans or where some human values are eliminated.

So they each have kind of various possible forms of perverse instantiation or side effects.

So they each have kind of various possible forms of perverse instantiation or side effects.

Yeah, I think... So there's a wide class of possible AIs that could be created.

Yeah, I think... So there's a wide class of possible AIs that could be created.

It's a mistake, I think, to think of there's this one AI, should we create it or not?

It's a mistake, I think, to think of there's this one AI, should we create it or not?

It's a big space of possible minds.

It's a big space of possible minds.

much bigger than the space of all possible human minds.

much bigger than the space of all possible human minds.

We already know that amongst humans, right, there are some really nice people.

We already know that amongst humans, right, there are some really nice people.

There are some really nasty ones as well.

There are some really nasty ones as well.

And there's like a distribution.

And there's like a distribution.