Manolis Kellis

But I think on the AI front, a lot more needs to happen.

So basically right now it's these language models and we believe that within their parameters, we're encoding these types of things.

And in some aspects it might be true, it might be truly emergent intelligence that's coming out of that.

In other aspects, I think we have a ways to go.

So basically to make all of these dreams that we're sort of discussing come reality, we basically need a lot more reasoning components, a lot more sort of logic, causality, models of the world.

And I think all of these things will

will need to be there in order to achieve what we're discussing.

And we need more explicit representations of these knowledge, more explicit understanding of these parameters.

And I think the direction in which things are going right now is absolutely making that possible by sort of enabling, you know, ChatGPT and GPT-4 to sort of search the web and, you know, plug and play modules and all of these sort of components.

In Marvin Minsky's The Society of Mind, he truly thinks of the human brain as a society of different kind of capabilities.

And right now, a single such model

might actually not capture that.

And I sort of truly believe that by sort of this side-by-side understanding of neuroscience and sort of new neural architectures, that we still have several breakthroughs.

I mean, the transformer model was one of them, the attention sort of aspect, the memory component,

all of these, you know, the representation learning, the pretext training of being able to sort of predict the next word or predict the missing part of the image.

And the only way to predict that is to sort of truly have a model of the world.

I think those have been transformative paradigms.

But I think going forward, when you think about AI research, what you really want is perhaps more inspired by the brain, perhaps more that is just orthogonal to sort of how human brains work, but sort of more of these types of components.

And you can go back to the human brain and basically look at places where there's been accidents.

For example, the corpus callosum of some individuals can be damaged.