Andrej Karpathy

Like, why can't other LLMs read this LLM's book and be inspired by it or shocked by it or something like that?

There's no equivalence for any of this stuff.

Interesting.

I think there's two powerful ideas in the realm of multi-agent that have both not been like really claimed or so on.

The first one I would say is culture and LLM is basically a growing repertoire of knowledge for their own purposes.

The second one looks a lot more like the powerful idea of self-play.

in my mind, is extremely powerful.

So evolution actually has a lot of competition, basically, driving intelligence and evolution.

And in AlphaGo, more algorithmically, AlphaGo is playing against itself, and that's how it learns to get really good at Go.

And there's no equivalent of self-playing LLMs, but I would expect that to also exist, but no one has done it yet.

Why can't an LLM, for example, create a bunch of problems that another LLM is learning to solve?

And then the LLM is always trying to serve more and more difficult problems.

stuff like that, you know?

So like, I think there's a bunch of ways to actually organize it.

And I think it's a realm of research.

But I think I haven't seen anything that convincingly like claims both of those, like multi-agent improvements.

I still think we're mostly in the realm of a single individual agent.

But I think, I also think that will change.

And in the realm of culture also, I would bucket also organizations.

And we haven't seen anything like that convincingly either.