Max Tegmark

Can it prove that you can never write...

a to the n plus b to the n equals z to the n for all integers, et cetera, et cetera, when n is bigger than 2.

That's simply a question about intelligence.

Can you build machines that are that intelligent?

And I think by the time we get a machine that can

independently come up with that level of proofs, probably quite close to AGI.

The second question is a question about consciousness.

How likely is it that such a machine would actually have any experience at all, as opposed to just being like a zombie?

And would we expect it to have some sort of emotional response to this or anything at all akin to human emotion where

when it accomplishes its machine goal, it views it as somehow something very positive and sublime and deeply meaningful.

I would certainly hope that if in the future we do create machines that are our peers or even our descendants, I would certainly hope that they do have this sort of sublime appreciation of life.

In a way, my absolutely worst nightmare would be that at some point in the future, the distant future, maybe our cosmos is teeming with all this post-biological life doing all this seemingly cool stuff.

And maybe the last humans, by the time our species eventually...

fizzles out will be like, well, that's okay.

Cause we're so proud of our descendants here.

And look what all the, my worst nightmare is that we haven't solved the consciousness problem.

And we haven't realized that these are all the zombies.

They're not aware of anything any more than the tape recorders.

It hasn't any kind of experience.

So the whole thing has just become a play for empty benches.