Ilya Sutskever

prove a verifier, you have some kind of an LLM as a judge, which is also incentivized to find mistakes in your work, you could say this is not exactly self play.

But this is, you know, a related adversarial setup that people are doing, I believe.

And really, self-flay is a special case of more general competition between agents.

The natural response to competition is to try to be different.

And so if you were to put multiple agents and you tell them, you know, you all need to work on some problem, and you're an agent, and you're inspecting what everyone else is working, you're going to say, well, if they're already taking this approach...

It's not clear I should pursue it.

I should pursue something differentiated.

And so I think that something like this could also create an incentive for a diversity of approaches.

I can answer, so I can comment on this for myself.

I think different people do it differently.

But one thing that guides me personally is an aesthetic of how AI should be by thinking about how people are, but thinking correctly.

It's very easy to think about how people are incorrectly, but what does it mean to think about people correctly?

So I'll give you some examples.

The idea of the artificial neuron is directly inspired by the brain.

And it's a great idea.

Why?

Because you say, sure, the brain has all these different organs, it has the folds, but the folds probably don't matter.

Why do we think that the neurons matter?

Because there's many of them.

It kind of feels right, so you want the neuron.