Benedict Evans

And if the answer is this is what ChatGPT would have said, then I didn't publish it.

Not because people can get it from chat GPT, but because anyone would have said that.

So I think there's two or three directions we could take that.

One of them is, it's an interesting theoretical philosophical question, is originality, which is to say AlphaGo could do original moves because it could do all the moves and do moves that no one had done before, not knowing what people had done before.

But it had an external scoring system.

It knew that that move was good.

Mm-hmm.

Because they don't have feedback.

Yeah, you have a feedback loop because every move has a score.

They can evaluate the score every move.

The classic parable of the monkeys and typewriters, all you know, the Borgia's Infinite Library is there's no feedback loop.

Yes, the Borgia's Infinite Library contains new masterpieces generated at random.

Well, the monkeys with typewriters would generate new masterpieces, but there's no feedback loop, so there's no way of knowing.

You'll see this with music now.

You can generate new music.

It could generate new stuff that you wouldn't know.

For an LLM, variance is bad.

Originality is a lower score.

So what's the feedback loop for original but good?

Now, it might be that that's the same sort of false question as saying, is it really reasoning or is it just right?