Jan Kulveit

Why You Don't Believe in Courser Prophesies by Jan Colvait Published on February 13, 2026 Based on a talk at the Post-AGI Workshop Also on Boundedly Rational

Does anyone reading this believe in coarser cattle killing prophesies?

My claim is that it's overdetermined that you don't.

I want to explain why, and why cultural evolution running on AI substrate is an existential risk.

But first, a detour.

When I go climbing in the Alps, I sometimes notice large crosses on mountain tops.

You climb something three kilometers high, and there's this cross.

This is difficult to explain by human biology.

We have preferences that come from biology.

We like nice food, comfortable temperatures, but it's unclear why we would have a biological need for crosses on mountain tops.

Economic thinking doesn't typically aspire to explain this either.

I think it's very hard to explain without some notion of culture.

In our paper on gradual disempowerment, we discussed misaligned economies and misaligned states.

People increasingly get why those are problems.

but misaligned culture is somehow harder to grasp.

I'll offer some speculation why later, but let me start with the basics.

What makes Black Forest cake fit?

The conditions for evolution are simple.

Variation, differential fitness, transmission.

Following Boyd and Richardson, or Dawkins, you can think about cultural variants, ideas, memes, as replicators.