Yoshua Bengio

The problem is, even though we give the goals, like this particular mission that the AI has for a company, we didn't say, well, here's exactly how you're going to do it.

And so the AI figures out.

a plan.

Well, that's how we train them anyways.

And if you want to build systems that will achieve goals in the world, which is what you want if you want to replace everyone's job, you need AIs that can do that.

That means they learn to create sub goals.

And the problem is we don't check those sub goals.

We can't because they were generated by the AI, not by us.

And why can't we check them?

We can't see them?

They might not even be explicit.

The AI might come up with a particular strategy, but not necessarily tell us.

And right now, sometimes we can see it in what's called the chain of thoughts.

In other words, a sequence of words that they generate that we don't usually see before they produce an answer.

Yes.

One of the things that got me excited with neural nets very early on

in the early 90s is the fact that they represent information not with symbols, with words like we do when we speak, but through a pattern of activations of these artificial neurons.

So the information is completely distributed.

Each unit, like each artificial neuron, can represent many different things.

They're not like, oh, this means that and this means that.