Learning Transformer Programs with Dan Friedman - #667

episode

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

Related

recent transcribed audio

A.I. Safety Goes Mainstream + a ‘Hard Fork’ Exit AMA 1h 25m · 18 Sep 2026 · Hard Fork

AWP: Beyond the Exam Room: Purpose, Myopia, and Population Health 54 min · 17 Sep 2026 · EyeCode Media

Essentials: How to Assess & Improve All Aspects of Your Fitness | Dr. Andy Galpin 35 min · 17 Sep 2026 · Huberman Lab

#502 – Psychiatry, Insane Asylums, Mental Illness, ECT, Lobotomies, Freud & Jung 3h 43m · 17 Sep 2026 · Lex Fridman Podcast

September 16, 2026 PC - Sep 16, 2026 1h 50m · 16 Sep 2026 · Fairfax County Planning Commission

Planning Commision 09/16/2026 - Sep 16, 2026 56 min · 16 Sep 2026 · Prince William County Planning Commission

Report any issue

Source

Recorded15 Jan 2024

Publisherfeeds.megaphone.fm ↗

Handlerec:12495868

Show notes

Today, we continue our NeurIPS series with Dan Friedman, a PhD student in the Princeton NLP group. In our conversation, we explore his research on mechanistic interpretability for transformer models, specifically his paper, Learning Transformer Programs. The LTP paper proposes modifications to the transformer architecture which allow transformer models to be easily converted into human-readable programs, making them inherently interpretable. In our conversation, we compare the approach proposed by this research with prior approaches to understanding the models and their shortcomings. We also dig into the approach’s function and scale limitations and constraints. The complete show notes for this episode can be found at twimlai.com/go/667.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in