Eliezer Yudkowsky

It just has to be life.

If in the future there were routinely

more than one AI, let's say two for the sake of discussion, who would look at each other and say, I am I, and you are you.

The other one also says, I am I, and you are you.

And sometimes they were happy, and sometimes they were sad.

And it mattered to the other one that this thing that is different from them is like...

they would rather it be happy than sad, and entangled their lives together, then this is a more optimistic thing than I expect to actually happen.

A little fragment of meaning would be there, possibly more than a little, but that I expect this to not happen, that I do not think this is what happens by default, that I do not think that this is the future we are on track to get, is...

So why would I go down fighting rather than just saying, oh well?

It's all the things that I value about it and maybe all the things that I would value if I understood it better.

There's not some meaning far outside of us that we have to wonder about.

There's just like looking at life and being like, yes, this is what I want.

The meaning of life is not some kind of... Meaning is something that we bring to things when we look at them.

We look at them and we say, this is its meaning to me.

It's not that before humanity was ever here, there was some meaning written upon the stars where you could go out to the star where that meaning was written and change it around and thereby completely change the meaning of life.

Right?

The notion that this is written on a stone tablet somewhere implies you could change the tablet and get a different meaning, and that seems kind of wacky, doesn't it?

So it doesn't feel that mysterious to me at this point.

It's just a matter of being like, yeah, I care.

I care.