Rob, Luisa, and the 80000 Hours team

In terms of proportion of all the available resources in the universe or even just the solar system, it's basically completely negligible.

So why do the AIs care so much to kind of squeeze that last bit of, you know, space and energy away from the human beings?

I guess maybe I'm naive, but I figure by this kind of stage, we're very far along into the future.

Presumably we do have some sort of wave of settlement of the solar system and potentially other star systems beginning to occur around this time.

I would think that at that stage,

Just because we need to figure out how to divide the resources that are not on Earth between different powerful groups, potentially China, the US, maybe other entities that want to have a say and get their share.

In order for that to go in a way that's not extremely violent or not extremely competitive, we would want to have done some division and figured out how are we going to share the surface of the Earth between AIs versus humans?

How are we going to want to share the resources in space so that we don't just fight over them and completely waste them all in the process?

So perhaps I kind of already have the picture that we need some greater level of coordination than now, or we're just going to get towards like a more catastrophically bad outcome relatively quickly.

Yeah.

I appreciate that this might sound a little bit, what I'm about to say might sound a little bit strange to people who haven't been marinating in these ideas around AI for months or possibly years.

But one thing that's worth adding is that many people believe that in this AI-dominated future, it will potentially be a lot easier to coordinate between different groups and to form agreements that are kind of stable over the long term.

because you could design sort of an AI hegemon that everyone could inspect and see that it really does want to follow through and enforce this division of resources between all of these different groups.

And so you have this, I guess, ability to enforce agreements between countries, between very powerful actors in the long term, even if the agreement involves one of them becoming much more powerful than the other one, that will continue to kind of be enforced in a way that has never been possible in the past.

So I guess that's one sort of hopeful picture.

I guess it could also go in a bad direction.

But it's one way that we could potentially solve these coordination problems going forward in a way that we have not been able to in the past.

And usually we've ended up in just violence or conflict when such a case has come up.

So you think that we could go through a stage where there kind of is an agreement or the government is operating such that it is redistributing income to humans or human-like entities.

enough that all of them can survive and potentially have a pretty good time.