Richard Sutton

If you say something in your conversation, the large language models have no prediction about what the person will say in response to that or what the response will be.

Oh, no, they will respond to that question right.

But they have no prediction in the substantive sense that they won't be surprised by what happens.

And if something happens that isn't what you might say they predicted, they will not change because an unexpected thing has happened.

And to learn that, they'd have to make an adjustment.

I'm just saying they don't have, in any meaningful sense, they don't have a prediction of what will happen next.

They will not be surprised by what happens next.

They'll not make any changes if something happens based on what happens.

It's not what the world will give them in response to what they do.

Let's go back to their lack of goal.

For me, having a goal is the essence of intelligence.

Right.

Something is intelligent if it can achieve goals.

I like John McCarthy's definition that intelligence is the computational part of the ability to achieve goals.

Yeah.

So you have to have goals.

You're just a behaving system.

You're not anything special.

You're not intelligent.

Right.