Richard Sutton

there's no government or organization that gives humanity a unified point of view that dominates and that can arrange.

There's no consensus about how the world should be run.

And number two, we will figure out how intelligence works.

Researchers will figure it out eventually.

And number three, we won't stop

Just with human-level intelligence, we will reach superintelligence.

And number four is that it's inevitable over time that the most intelligent things around would gain resources and power.

And, uh, so put all that together, it's, you know, you, um, it's sort of inevitable that you're going to have, um, succession to AI or to AI enabled augmented humans.

So within those, those four things seem clear and, and, and sure to happen.

Uh, but within that set of possibilities, some, there can be good outcomes as well as less good outcomes, bad outcomes.

And, um,

So I'm just trying to be realistic about where we are and ask how we should feel about it.

Right.

And so then I do encourage people to think positively about it, first of all, because it's something we humans have always tried to do for thousands of years, tried to understand themselves, trying to make themselves think better.

And...

you know, just understand themselves.

So this is a great success as science, humanities.

We're finding out what this essential part of humanness is, what it means to be intelligent.

And then what I usually say is that this is all kind of human-centric.

What if we look, you step aside from being a human and just say, take the point of view of the universe.