Marcus Hutter

And actually, interestingly, for this agent, we can prove much stronger result than for the general agent, which is also nice.

And if you let this agent loose, it will be, in a sense, the optimal scientist.

It is absolutely curious to learn as much as possible about the world.

And of course, it will also have a lot of instrumental goals, right?

In order to learn, it needs to at least survive, right?

A dead agent is not good for anything.

So it needs to have self-preservation.

And if it builds small helpers, acquiring more information, it will do that, yeah?

If

exploration, space exploration or whatever is necessary, right, to gathering information and develop it.

So it has a lot of instrumental goals falling on this information gain.

And this agent is completely autonomous of us.

No rewards necessary anymore.

The first agent had this problem.

It would get stuck in front of an old TV screen, which has just had white noise.

But the second version can deal with at least stochasticity well.

I think that's a nice definition.

Curiosity is reward.

Sorry, curiosity is exploration for its own sake.

Yeah, I would accept that.