Gary Marcus

And what people in cognitive science, which is my native discipline, will tell you, if they know what they're doing, is that intelligence is a multidimensional thing.

So, you know, they have the intelligence to play chess really, really well, better than I can, you know.

I got beat by a chess computer in like, when was it, in 1999 or I don't know, a long time ago, I can't even remember.

Well, I mean, I guess Kasparov got beat by the best one in 97.

Yeah, I wouldn't beat yourself up about it.

I played Kasparov once, by the way, and he annihilated me while playing with one of the other people.

Anyway, I'm not a great chess player, but the point is, it was probably even earlier that I got beat.

But, you know...

AI can play chess really well, it can play Go really well.

A GPS navigation system, a different kind of AI that can do navigation really well.

But LLMs can't do a lot of things.

So LLMs actually are not good chess players, as it turns out.

They make illegal moves.

They can't even follow the rules.

And so their stupidity about rule following, and you just gave a beautiful example of this, that's what you need to worry about, right?

You know, the reason that we need to regulate LLMs

them is because they don't reliably follow instructions.

It's not that they can't do anything that you might characterize as intelligent.

You could argue about your definitions of intelligence.

So one definition would be that you can do essentially any kind of problem given enough resources.