Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Ada Palmer

๐Ÿ‘ค Speaker
275 total appearances

Appearances Over Time

Podcast Appearances

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

But Palmer's approach suggests otherwise.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

Experimental history is possible.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

not in the sense of manipulating the past, but in the sense of systematically exploring its possibility space.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

Her simulation is an experiment.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

Controlled conditions, repeated trials, emergent patterns.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

It will never achieve the precision of physics, but it's a genuine advance beyond purely descriptive history, as we know it.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

The limitation is obvious.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

Palmer can run her simulation perhaps 10 times over the years she teaches the course.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

But what if we could run 50 simulations per day, as weather forecasters do?

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

What if we do that for an entire year?

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

We'd end up with tens of thousands of simulations and a detailed probabilistic landscape of the political situation of 1492.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

Enter history of LLMs, large language models trained exclusively on texts from specific historical periods.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

The idea emerged from a fundamental problem.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

Modern LLMs cannot forget.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

A generic LLM knows what already happened.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

No amount of prompting can remove this hindsight bias, which, by the way, it shares with Palmer students.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

A historian studying the Renaissance cannot UN-know what came next, and neither can a model trained on Wikipedia.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

But what if you could train an LLM only on texts available before a specific date?

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

Researchers at the University of Zurich recently built RANK4B, a language model trained exclusively on pre-1913 texts.

LessWrong (Curated & Popular)
"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

The model literally doesn't know World War I happened.