“AI welfare research needs basic science” by OscarGilg, Pierre Beckmann, Jake1638

episode

LessWrong (30+ Karma) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from LessWrong (30+ Karma)

“Claude Opus 4.5 Achieves 50%-Time Horizon Of Around 4 hrs 49 Mins” by Michaël Trazzi 3 min · 20 Dec 2025

All episodes from LessWrong (30+ Karma) →

Report any issue

Source

Recorded02 Jul 2026

Publisherfeeds.type3.audio ↗

Handlerec:19149634

Show notes

Over the course of MATS 9.0 we formed some views about AI welfare research that we thought were worth writing up. This post is meant to spark discussion rather than to present definitive conclusions. Thanks to Patrick Butlin for useful comments on a previous draft, and for many conversations over the course of MATS which influenced our views. Thanks also to Caspar Kaiser for comments. A prominent approach in AI welfare research is to start from a theory of moral patienthood, derive indicators from it, and attempt to apply it to AI systems to determine whether they satisfy the theory. We'll refer to this as the top-down theory-driven approach[1]. We think this approach faces two problems: In practice, applying theories to AI systems requires making assumptions that are hard to justify, which limits the strength of conclusions.More broadly, we think current theories will fail to generalise to AI systems. They are calibrated to humans, and as a result end up either over-inclusive (assigning moral patienthood to entities that should not be included), under-inclusive (failing to assign moral patienthood to entities that should be included), or indeterminate (failing to provide a clear verdict about the moral patienthood of [...] ---Outline:(02:03) 1. Issues with the top-down theory-driven approach(04:48) 1.1. Applying theories to AI systems requires making assumptions that often undermine welfare-relevant conclusions(09:15) 1.2. Current theories of moral patienthood will not generalise to AI systems(12:18) 2. AI welfare needs basic science(13:56) 2.1. Philosophical probes(16:25) 2.2. Integrating empirical findings into theories(19:43) Conclusion The original text contained 3 footnotes which were omitted from this narration. --- First published: July 1st, 2026 Source: https://www.lesswrong.com/posts/ht8uMbAByDCKWHa9H/ai-welfare-research-needs-basic-science --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.