Dr. Jeff Beck

something that would be closer to true artificial intelligence than what we currently have would be capable of building models on the fly to deal with new situations, to taking things that it knows about, right, and combining them in new and different ways.

There are approaches that have some of that aspect to it, like Gflow nets from like Benjio stuff is like a great example of something that at least in principle is a generative model of generative models, right?

It's sort of like, oh,

like you know i might actually need a new node like it's time to create a new latent variable because like like the current set's just not cutting the mustard anymore those are things that that i think are hallmarks of of true intelligence i don't want to ever make the statement as soon as it's got that it's truly intelligent i will never ever ever say that um but i do think that that is a a critical component that that needs to be present right is the ability to generate new models

on the fly to deal with novel situations and data.

Most of that, you know, as well as the ability to combine old models, previous models in new and interesting ways.

This is actually how the brain evolved, right?

We started out with like,

you know, really simple brains and there were different regions and they solve sort of different problems.

And what eventually happened as we evolved is that these different regions of the brain learned to communicate with each other in new ways.

And through that communication, acquired new abilities, right?

And then eventually evolved into, you know, new capabilities and things like that, right?

I often like to point out to the, I think olfaction is like the

the sense that's not studied nearly enough.

It's an incredibly old part of the brain.

And arguably, it's the first part of the brain that evolved the ability to do proper associative processing.

Unlike visual space, where there's translation symmetries and all that sort of stuff and things are smooth, olfactory space, that does not exist.

It's really, really, really combinatorial and complicated.

And the part of the brain that evolved to solve the olfactory problem, arguably, is the part that evolved into our frontal cortex.

Don't quote me on that.