Francois Chollet

In order to do effective reasoning, you need memory.

It's not really a size issue.

It's more like a train data issue in this case.

No, it's not.

If you scale up your database and you keep adding to it more knowledge, more program templates, then sure, it becomes more and more skillful.

You can apply it to more and more tasks.

But general intelligence is not task-specific skill scaled up to many skills.

Because there is an infinite space of possible skills.

General intelligence is the ability to approach any problem, any skill, and very quickly master it using very little data.

Because this is what makes you able to face anything you might ever encounter.

This is what makes

This is the definition of generality.

Like generality is not specificity scaled up.

It is the ability to apply your mind to anything at all, to arbitrary things.

And this requires, fundamentally, this requires the ability to adapt, to learn on the fly efficiently.

If you're right, if you were right, LLMs would do really well on arc puzzles because arc puzzles are not complex.

Each one of them requires very little knowledge.

Each one of them is very low on complexity.

You don't need to think very hard about it.

They're actually extremely obvious for humans, like even children can do them.