Jeremiah

So we have evolution, sex and reproduction, for a human, and for an LLM it's incentives, AI company profit motive.

For the human we have predictive coding, next sense datum prediction.

LLM has training, next token prediction.

Then for a human, next we have, I don't know, I just thought about it really hard.

And then an LLM has question mark, maybe nothing?

Then the human has, for example, high D toroidal attractor manifolds.

And for an LLM, for example, rotation of 6D helical manifolds.

And then for the human, finally we have neurons and neurotransmitters.

And for the LLM we have chips and electricity.

2.

The human brain was designed by a series of nested optimization loops.

The outermost loop is evolution, which optimized the human genome for being good at survival, sex, reproduction, and child-rearing.

But evolution can't encode everything important in the genome.

It obviously can't include individual and cultural features like the vocabulary of your native language, or your particular mother's face.

But even a lot of things that could be there in theory, like how to walk, or which animals are most nutritious, are missing.

The genome is too small for it to be worth it.

Instead, evolution gives us algorithms that let us learn from experience.

These algorithms are a second optimization loop, evolving in quotes neuron patterns into forms that better promote fitness, reproduction, etc.

The most powerful such algorithm is called predictive coding, which neuroscience increasingly considers a key organizing principle of the brain.

Wikipedia describes it as, quote,