Geoffrey Hinton

And the only number I was given was these 35 sheep.

So they're operating at a sort of

substituting symbols level.

The AIs can sometimes be seduced into making similar mistakes, but the way the AIs actually work is quite like people.

They take a problem and they start thinking.

And you might, for a child, you might say, okay, well, how old is the captain?

Well, what are the numbers I've got in this problem?

Hey, I've only got a 35.

Is that a plausible age for a captain?

Yeah, it might be 35, a bit young, but maybe, okay, I'll say 35.

That's what a 10-year-old child might think.

And the child would think it to itself in words.

And what people realized with these language models is you can train them to think to themselves in words.

That's called chain of thought reasoning.

And they trained them to do that.

And after that, you give them a problem, they'd think to themselves, just like a kid would, and sometimes come up with the wrong answer.

But you could see them thinking.

So it's just like people.

Okay, that's about half a dozen major questions.

Well, how long have we got?