Francois Chollet

I think if you try to make by hand hundreds of thousands of Arc tasks, and then you try to multiply them by programmatically generating variations, and then you end up with maybe hundreds of millions of tasks,

Just by brute forcing the task space, there will be enough overlap between what you're trained on and what's in the test set that you can actually score very highly.

So, you know, with enough scale, you can always cheat.

If the world, if your life were a static distribution, then sure, you could just brute force the space of possible behaviors.

Like, you know, the way I would think about intelligence...

There are several metaphors I like to use, but one of them is you can think of intelligence as a pathfinding algorithm in future situation space.

Like, I don't know if you're familiar with game development, like RTS game development, but you have a map, right?

And you have, it's like a 2D map, and you have partial information about it.

Like there is some fog of war on your map.

There are areas that you haven't explored yet.

You know nothing about them.

And then there are areas that you've explored, but you only know how they were like in the past.

You don't know how they are like today.

And

And now, instead of thinking about a 2D map, think about the space of possible future situations that you might encounter and how they're connected to each other.

Intelligence is a pathfinding algorithm.

So once you set a goal, it will tell you how to get there optimally.

But of course, it's constrained by the information you have.

It cannot pass fine in an area that you know nothing about.

It cannot also anticipate changes.