Max Tegmark

But yeah, we can come back to the details of that and how you might get the human level AI, even if

I'm both very excited about it and terrified.

interesting mixture of emotions all the best things in life include those two somehow yeah i can absolutely reason anyone who hasn't played with it i highly recommend doing that before dissing it it can do quite quite remarkable reasoning and

I've had to do a lot of things, which I realized I couldn't do that myself that well, even.

And obviously does it dramatically faster than we do too, when you watch it type.

And it's doing that while servicing a massive number of other humans at the same time.

At the same time, it cannot reason...

as well as a human can on some tasks.

It's obviously a limitation from its architecture.

We have in our heads, what in geek speak is called a recurrent neural network.

There are loops.

Information can go from this neuron to this neuron to this neuron, and then back to this one.

You can ruminate on something for a while.

You can self-reflect a lot.

uh these large language models that are they cannot like gpt4 it's it's a so-called transformer where it's just like a one-way street of information basically in geek speak it's called a feed forward neural network and it's only so deep so it can only do logic that's that many steps and that deep and it's not and you can sure you can create problems which will fail to solve you know for that reason um

But the fact that it can do so amazing things with this incredibly simple architecture already is quite stunning.

And what we see in my lab at MIT, when we look inside large language models to try to figure out how they're doing it, that's the key core focus of our research.

It's called mechanistic interpretability in GeekSpeak.

You have this machine that does something smart.

You try to reverse engineer, see how does it do it.