Andrej Karpathy

And it's kind of like one of the, I think, impediments, I would say.

Can you give me some sense of what LLM culture might look like?

So in the simplest case, it would be a giant scratchpad that the LLM can edit.

And as it's reading stuff or as it's helping out with work, it's editing the scratchpad for itself.

Why can't an LLM write a book for the other LLMs?

That would be cool.

Like, why can't other LLMs read this LLM's book and be inspired by it or shocked by it or something like that?

There's no equivalence for any of this stuff.

Interesting.

I think there's two powerful ideas in the realm of multi-agent that have both not been like really claimed or so on.

The first one I would say is culture and LLM is basically a growing repertoire of knowledge for their own purposes.

The second one looks a lot more like the powerful idea of self-play.

in my mind, is extremely powerful.

So evolution actually has a lot of competition, basically, driving intelligence and evolution.

And in AlphaGo, more algorithmically, AlphaGo is playing against itself, and that's how it learns to get really good at Go.

And there's no equivalent of self-playing LLMs, but I would expect that to also exist, but no one has done it yet.

Why can't an LLM, for example, create a bunch of problems that another LLM is learning to solve?

And then the LLM is always trying to serve more and more difficult problems.

stuff like that, you know?

So like, I think there's a bunch of ways to actually organize it.