LessWrong (Curated & Popular)

"AlgZoo: uninterpreted models with fewer than 1,500 parameters" by Jacob_Hilton

27 Jan 2026

Audio

Description

Audio note: this article contains 78 uses of latex notation, so the narration may be difficult to follow. There's a link to the original text in the episode description. This post covers work done by several researchers at, visitors to and collaborators of ARC, including Zihao Chen, George Robinson, David Matolcsi, Jacob Stavrianos, Jiawei Li and Michael Sklar. Thanks to Aryan Bhatt, Gabriel Wu, Jiawei Li, Lee Sharkey, Victor Lecomte and Zihao Chen for comments. In the wake of recent debate about pragmatic versus ambitious visions for mechanistic interpretability, ARC is sharing some models we've been studying that, in spite of their tiny size, serve as challenging test cases for any ambitious interpretability vision. The models are RNNs and transformers trained to perform algorithmic tasks, and range in size from 8 to 1,408 parameters. The largest model that we believe we more-or-less fully understand has 32 parameters; the next largest model that we have put substantial effort into, but have failed to fully understand, has 432 parameters. The models are available at the AlgZoo GitHub repo. We think that the "ambitious" side of the mechanistic interpretability community has historically underinvested in "fully understanding slightly complex [...] ---Outline:(03:09) Mechanistic estimates as explanations(06:16) Case study: 2nd argmax RNNs(08:30) Hidden size 2, sequence length 2(14:47) Hidden size 4, sequence length 3(16:13) Hidden size 16, sequence length 10(19:52) Conclusion The original text contained 20 footnotes which were omitted from this narration. --- First published: January 26th, 2026 Source: https://www.lesswrong.com/posts/x8BbjZqooS4LFXS8Z/algzoo-uninterpreted-models-with-fewer-than-1-500-parameters --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Transcription

This episode hasn't been transcribed yet

Help us prioritize this episode for transcription by upvoting it.

0 upvotes

🗳️ Sign in to Upvote

Popular episodes get transcribed faster

Other episodes from LessWrong (Curated & Popular)

Transcribed and ready to explore now

"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

28 Jan 2026

LessWrong (Curated & Popular)

"The inaugural Redwood Research podcast" by Buck, ryan_greenblatt

27 Jan 2026

LessWrong (Curated & Popular)

"Canada Lost Its Measles Elimination Status Because We Don’t Have Enough Nurses Who Speak Low German" by jenn

26 Jan 2026

LessWrong (Curated & Popular)

[Linkpost] "“The first two weeks are the hardest”: my first digital declutter" by mingyuan

20 Jan 2026

LessWrong (Curated & Popular)

"Why we are excited about confession!" by boazbarak, Gabriel Wu, Manas Joglekar

19 Jan 2026

LessWrong (Curated & Popular)

"Backyard cat fight shows Schelling points preexist language" by jchan

16 Jan 2026

LessWrong (Curated & Popular)

View all episodes from LessWrong (Curated & Popular)

Comments

There are no comments yet.

Please log in to write the first comment.

Report any issue

LessWrong (Curated & Popular)

"AlgZoo: uninterpreted models with fewer than 1,500 parameters" by Jacob_Hilton

This episode hasn't been transcribed yet

Other episodes from LessWrong (Curated & Popular)

"Ada Palmer: Inventing the Renaissance" by Martin Sustrik

"The inaugural Redwood Research podcast" by Buck, ryan_greenblatt

"Canada Lost Its Measles Elimination Status Because We Don’t Have Enough Nurses Who Speak Low German" by jenn

[Linkpost] "“The first two weeks are the hardest”: my first digital declutter" by mingyuan

"Why we are excited about confession!" by boazbarak, Gabriel Wu, Manas Joglekar

"Backyard cat fight shows Schelling points preexist language" by jchan

Sign in to Audioscrape

Share this moment