Marcus Hutter

OK, so.

But there is ways of getting computable approximations of the ICSI model.

So then it's at least computable.

It is still way beyond any resources anybody will ever have.

But then the Gödel machine could sort of improve it further and further in an exact way.

It is optimal in terms of the reward collected over its interaction cycles, but it takes infinite time to produce one action.

And the world continues whether you want it or not.

So the model is assuming you had an oracle which solved this problem and then in the next 100 milliseconds or the reaction time you need gives the answer, then AXE is optimal.

So it's optimally in sense of data, also from learning efficiency and data efficiency, but not in terms of computation time.

You say humans are an instantiation of an IC agent?

Yes.

Oh, that would be amazing.

But I think that's not true even for the smartest and most rational humans, I think.

Maybe we are very crude approximations.

Well, some flaws...

if you think more carefully about it, are actually not flaws, yeah, but I think there are still enough flaws.

I don't know.

That's your Russian background, I think.

Let me also ask you a question.

Do you think I'm conscious?