Francois Chollet

All you need is more data.

It's a representation of a data set, an interpretive representation of a data set.

That's the easy part.

The hard part is the architecture of intelligence.

Memory and intelligence are separate components.

We have the memory.

We don't have the intelligence yet.

And I agree with you that, well, having the memory is actually very useful.

And if you just had the intelligence, but it was not hooked up to an extensive memory, it would not be that useful because it would not have enough material to work from.

You are, yeah, yeah, yeah.

It's a matter of degree.

You know, it's a matter of degree.

If you have a system that has a memory and is only capable of doing local generalization from that, it's not going to be very adaptable.

To be really general, you need the memory plus the ability to search to quite some depth to achieve broader, even extreme generalization.

Like, one of my favorite psychologists, so Jean Piaget, who is the founder of developmental psychology, he had a very good quote about intelligence.

He said, intelligence is what you use when you don't know what to do.

And it's like...

As a human living your life, in most situations, you already know what to do because you've been in this situation before.

You already have the answer, right?

And you're only going to need to use intelligence when you're faced with novelty, with something you didn't expect, with something that you weren't prepared for, either by your own experience, your own life experience, or by your evolutionary history.