Andrej Karpathy

You might not even be able to pick us up in that simulation.

And so how do you prove that you exist, that you're intelligent and that you're part of the universe?

Yeah, the puzzle is basically alerting the creator that we exist.

Or maybe the puzzle is just to break out of the system and just stick it to the creator in some way.

Basically, if you're playing a video game, you can somehow find an exploit and find a way to execute on the host machine in the arbitrary code.

For example, I believe someone got a game of Mario to play Pong just by exploiting it and then...

basically writing code and being able to execute arbitrary code in the game.

And so maybe that's the puzzle, is that we should find a way to exploit it.

So I think some of these synthetic AIs will eventually find the universe to be some kind of a puzzle and then solve it in some way.

And that's kind of like the end game somehow.

Yes.

Yeah, I think so.

Is that what physics is essentially?

I think it's possible that physics has exploits and we should be trying to find them.

Arranging some kind of a crazy quantum mechanical system that somehow gives you buffer overflow, somehow gives you a rounding error in the floating point.

We'll find some way to extract infinite energy.

For example, when you train reinforcement learning agents in physical simulations and you ask them to, say, run

quickly on the flat ground, they'll end up doing all kinds of weird things in part of that optimization.

They'll get on their back leg and they'll slide across the floor.

And it's because the optimization, the enforcement learning optimization on that agent has figured out a way to extract infinite energy from the friction forces and basically their poor implementation.