Francois Chollet

And you could say this is reasoning.

And I say, yeah, sure, okay.

But another definition you can use is reasoning is the ability to, when you're faced with a puzzle, given that you don't have already a program in memory to solve it,

You must synthesize on the fly a new program based on bits of pieces of existing programs that you have.

You have to do on-the-fly program synthesis.

And it's actually dramatically harder than just fetching the right memorized program and replying it.

Sure.

I mean, in order to do on-the-fly program synthesis, you actually need building blocks to work from.

So knowledge and memory are actually tremendously important in the process.

I'm not saying it's memory versus reasoning.

In order to do effective reasoning, you need memory.

It's not really a size issue.

It's more like a train data issue in this case.

No, it's not.

If you scale up your database and you keep adding to it more knowledge, more program templates, then sure, it becomes more and more skillful.

You can apply it to more and more tasks.

But general intelligence is not task-specific skill scaled up to many skills.

Because there is an infinite space of possible skills.

General intelligence is the ability to approach any problem, any skill, and very quickly master it using very little data.

Because this is what makes you able to face anything you might ever encounter.