Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jeremiah

๐Ÿ‘ค Speaker
1129 total appearances

Appearances Over Time

Podcast Appearances

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

This simple analogy is slightly off, because it's confusing two optimization levels.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

The outer optimization level, in humans, evolution optimizing for reproduction, in AI's, companies optimizing for profit, with the inner optimization level, in humans, next-sense-dartum prediction, in AI's, next-token prediction.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

But the stochastic parrot people probably haven't gotten to the point where they learn that humans are next-sense-dartum predictors,

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

so the evolution-slash-reproduction one above might make a better didactic tool.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

Below these prediction algorithms optimizing for various things are all the structures, algorithms, world models, and thought processes they've created.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

In both humans and AIs, these look like good, normal thinking.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

You do math by remembering PEMDAS and carrying the one.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

You deal with angry tigers by remembering principles like tigers like to pounce, and when an animal pounces, its actions will follow the laws of physics, which I intuitively approximate as X, Y, and Z. Below these intuitive processes are bizarre low-level algorithms involving helices and toroids.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

These are approximately equally creepy in humans and AIs, which makes sense because they were designed by the same inhuman process, next sense datum or next token prediction, and operate on similar materials, neural tissue, weights connected by parameters.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

Nothing about any of these levels of explanations supports a contention like humans are doing real thought, but AIs are simply next token predictors.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

There will be some algorithmic differences, and some of those might be important, and we can talk about their implications, but they're downstream of what specific prediction tasks each entity was trained on and what strengths and weaknesses their own evolutionary history gives them.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

The stochastic parrot people have many other arguments involving hallucinations, the differences between tokens and sense data, etc.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

I'm hoping to combine all my writing on this into an anti-stochastic parrot FAQ, so don't worry if I don't immediately rebut all of them in this post.

Astral Codex Ten Podcast
Next-Token Predictor Is An AI's Job, Not Its Species

Thank you for listening, and I'll speak to you next time.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Welcome to the Astral Codex X podcast for the 12th of February, 2026.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

Title, What Happened With Bio-Anchors?

Astral Codex Ten Podcast
What Happened With Bio Anchors?

This is an audio version of Astral Codex X, Scott Alexander's Substack.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

If you like it, you can subscribe at astralcodex10.substack.com.

Astral Codex Ten Podcast
What Happened With Bio Anchors?

The original post was Biological Anchors, A Trick That Might or Might Not Work.