Richard Sutton

I think more interesting is just think about that case.

Which when you have many AIs, will they help each other?

the way cultural evolution works in people.

Let's just, maybe we should talk about that.

The bitter lesson, oh, who cares about that?

That's an empirical observation about a particular period in history.

70 years in history, no longer, doesn't necessarily have to apply the next 70 years.

So the interesting question is, you're an AI, you get some more computer power.

Should you use it to make yourself more computationally capable?

Or should you use it to spawn off a copy of yourself to go learn something interesting on the other side of the planet or on some other topic and then report back to you?

Yep.

I think that's a really interesting question that will only arise in the age of digital intelligences.

I'm not sure what the answer is, but I think it will... More questions.

Will it be possible to really spawn it off, send it out, learn something new, something perhaps very new, and then will it be able to be reincorporated into the original?

Or will it have changed so much that...

It can't really be done.

Is that possible or is it not?

And you can carry this to its limit, as I saw one of your videos the other night that suggested that it could, where you spawn off many, many copies, do different things, highly decentralized, but report back to the central master.

And that this will be such a powerful thing.

Well, I think one thing that, so this is my attempt to add something to this view, is that a big question, a big issue will become corruption.