Andrej Karpathy

Yeah.

Like going through intelligence is actually a really fascinating breaking point.

Yeah, exactly.

You have to incentivize some kind of adaptability.

You actually want environments that are unpredictable.

So evolution can't bake your algorithms into your weights.

A lot of animals are basically pre-baked in this sense.

And so humans have to figure it out at test time when they get born.

And so maybe you actually want these kinds of environments that actually change really rapidly or something like that where you can't foresee what will work well.

And so you actually put all that intelligence, you create intelligence to figure it out at test time.

Yes and no, because LLMs don't really have the equivalent of culture.

And maybe we're giving them way too much and incentivizing not to create it or something like that.

But I guess like the mention of culture and of written record and of like passing down notes between each other, I don't think there's an equivalent of that with LLMs right now.

So LLMs don't really have culture right now.

And it's kind of like one of the, I think, impediments, I would say.

Can you give me some sense of what LLM culture might look like?

So in the simplest case, it would be a giant scratchpad that the LLM can edit.

And as it's reading stuff or as it's helping out with work, it's editing the scratchpad for itself.

Why can't an LLM write a book for the other LLMs?

That would be cool.