“Extracting Performant Algorithms Using Mechanistic Interpretability” by Ihor Kendiukhov

episode

LessWrong (30+ Karma) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from LessWrong (30+ Karma)

“Claude Opus 4.5 Achieves 50%-Time Horizon Of Around 4 hrs 49 Mins” by Michaël Trazzi 3 min · 20 Dec 2025

All episodes from LessWrong (30+ Karma) →

Report any issue

Source

Recorded18 Mar 2026

Publisherfeeds.type3.audio ↗

Handlerec:17086617

Show notes

A Prequel: The Tree of Life Inside a DNA Language Model Last year, researchers at Goodfire AI took Evo 2, a genomic foundation model, and found, quite literally, the evolutionary tree of life inside. The phylogenetic relationships between thousands of species were encoded as a curved manifold in the model's internal activations, with geodesic distances along that manifold tracking actual evolutionary branch lengths. Bacteria that diverged hundreds of millions of years ago were far apart on the manifold, and closely related species were nearby. The model was trained to predict the next DNA token. Nobody told it about evolution or gave it a phylogenetic tree as a training signal. But the model needed to encode evolutionary relationships in order to predict DNA well, and so it built a structured geometric representation of those relationships as part of its internal computation, and the representation was good enough that you could extract it with interpretability tools and compare it meaningfully to the ground truth. I saw this and decided to apply the same approach to another type of biological foundation models - those trained on single cell data. If Evo 2 learned the tree of life from raw DNA [...] ---Outline:(00:12) A Prequel: The Tree of Life Inside a DNA Language Model(01:30) Finding the Manifold(04:09) But Does the Extracted Algorithm Actually Work?(07:52) How Small Can You Go Though?(10:14) So, Mechanistic Interpretability is Becoming Dual Use(12:13) Mechanistic Intepretability for Novel Knowledge Discovery(13:02) Join In --- First published: March 14th, 2026 Source: https://www.lesswrong.com/posts/R4xxxAfNpAvpb3LCf/extracting-performant-algorithms-using-mechanistic-5 --- Narrated by TYPE III AUDIO.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.