Demis Hassabis

So you'd want to see those.

How you test that, I think you just test it.

One way to do it would be a brute force test of tens of thousands of cognitive tasks that we know that humans can do, and maybe also make the system available to

a few hundred of the world's top experts, the Terence Towers of each subject area, and see if they can find, you know, give them a month or two and see if they can find an obvious flaw in the system.

And if they can't, then I think you're pretty, you know, you can be pretty confident we have a fully general system.

This is special.

Exactly.

So I think there's the sort of blanket testing to just make sure you've got the consistency.

But I think there are the sort of lighthouse moments like the move 37 that I would be looking for.

So one would be inventing a new conjecture or a new hypothesis about physics like Einstein did.

So maybe you could even run the back test of that very rigorously, like

Have a cutoff of knowledge, cutoff of 1900, and then give the system everything that was written up to 1900 and then see if it could come up with special relativity and general relativity, right?

Like Einstein did.

That would be an interesting test.

Another one would be, can it invent a game like Go?

not just come up with move 37, a new strategy, but can it invent a game that's as deep, as aesthetically beautiful, as elegant as go?

And those are the sorts of things I would be looking out for.

And probably a system being able to do several of those things, right?

For it to be very general, not just one domain.

And so I think that would be the signs, at least that I would be looking for, that we've got a system that's AGI level.