“The Three Filters: Why Almost Every Plan to Survive ASI Fails Miserably” by Alex Amadori

episode

LessWrong (30+ Karma) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from LessWrong (30+ Karma)

“Claude Opus 4.5 Achieves 50%-Time Horizon Of Around 4 hrs 49 Mins” by Michaël Trazzi 3 min · 20 Dec 2025

All episodes from LessWrong (30+ Karma) →

Report any issue

Source

Recorded10 Jun 2026

Publisherfeeds.type3.audio ↗

Handlerec:18801412

Show notes

This post is based on my personal views, which mostly overlap with the views of my employer ControlAI but does not necessarily fully reflect them. This applies in particular, but not exclusively, to technical opinions about AI development and geopolitical predictions. You might’ve heard that superintelligent AI (ASI) poses extreme risks like human extinction and other comparably undesirable outcomes. If you’re like me, you probably looked into possible solutions. And if so, you may have found a range of reassuringly tractable theories of change. To name a few: Technical AI safety research agendasRacing to ASI so your favorite company or country can get there first and prevent anyone else from building “bad” ASIBuilding a good ASI and handing it control over the whole world (so that we don’t have to be subject to any evil human dictators) If you think about it, all of these feel quite convenient, especially if you’re a tech-leaning person: you don’t need to change your career at all. Just keep working on your favorite ASI project, and things will work out. It's quite easy to come across theories that predict good outcomes without needing to change your strategy at all, even [...] ---Outline:(03:41) Preamble: pressure to cut corners invalidates most theories of change(07:50) First filter: all-out war between nuclear superpowers(10:44) Contra "stable multipolar scenarios"(13:04) Second filter: misaligned AI that kills everyone(16:33) Why Technical AI safety agendas do not address this problem(19:50) Third filter: nightmare singletons(24:19) How common theories of change fail trivially(26:55) Conclusion The original text contained 10 footnotes which were omitted from this narration. --- First published: June 10th, 2026 Source: https://www.lesswrong.com/posts/BWNqdt5edJdax4jn8/the-three-filters-why-almost-every-plan-to-survive-asi-fails --- Narrated by TYPE III AUDIO.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.