Yoshua Bengio

I want to go back to your question as to why they are acting like this.

I don't think there's a definite answer, but there's an ingredient that we didn't touch, which is the change, which I consider radical, between the networks we had before 01.

and after.

Yes.

So thinking model.

So why do we call them thinking models?

Because they're using these chains of thoughts, the steps in which they can produce words for themselves that are private, which is like thought, right?

And they're learning to use these chains of thoughts to reason better in the sense that they're going to produce more accurate answers.

And so they learn to strategize.

They are incredibly better at mathematical problems, programming, scientific questions.

They don't reason as well as us in some ways, but compared to the models that existed previously, it's like night and day.

Things that were impossible are now really good, often even better than most humans.

No, it's more radical than that.

It's like...

The mathematics you can do without thinking about it, like let's say you've learned when you were a child that 16 plus seven is 13, and you don't need to think about it.

It's immediate, it's intuitive.

Versus if I ask you to do 37 plus 51.

Now, you can't do it, I mean, for most people, unless you think through either in your mind or on paper through steps.

That is the new part.

It's called system two.