Andrej Karpathy

So in my post, I kind of said, we're not actually building animals.

We're building ghosts or spirits or whatever people want to call it.

Because...

We're not doing training by evolution.

We're doing training by basically imitation of humans and the data that they've put on the internet.

And so you end up with these like sort of ethereal spirit entities because they're fully digital and they're kind of like mimicking humans.

And it's a different kind of intelligence.

Like if you imagine a space of intelligences, we're starting off at a different point almost.

We're not really building animals.

But I think it's also possible to make them a bit more animal-like over time.

And I think we should be doing that.

And so I kind of feel like, sorry, just I guess one more point is, I do feel like Sutton basically has a very, like his framework is like we want to build animals.

And I actually think that would be wonderful.

If we can get that to work, that would be amazing.

If there was a single like algorithm that you can just, you know, run on the internet and it learns everything, that would be incredible.

I almost suspect that I'm not actually sure that it exists.

And that's certainly actually not what animals do.

because animals have this outer loop of evolution.

And a lot of what looks like learning is actually a lot more maturation of the brain.

And I think there's actually very little reinforcement learning for animals.