Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Jacob Kimmel

๐Ÿ‘ค Speaker
972 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

So that's another version of what would a all-encompassing model look like, where you actually have compounding returns in drug discovery.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

Yeah, absolutely.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

So I think we actually do both today.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

So we can train these models where basically the inputs are a notion of what that cell looked like at the starting place.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

Here's what a generic old cell looked like.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

And then representations of the transcription factors themselves.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

We derive those from protein foundation models.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

They're language models basically to train on protein sequences.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

Turns out that gives you a really good base level understanding of biology.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

So the model is kind of starting from a pretty smart place.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

And then you can predict a number of different targets from some learned embedding the same way you could have multiple heads on a language model.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

And so one of those for us is actually just predicting every gene the cell is expressing.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

Can I just recapitulate the entire state and guess what effect these transcription factors will have on every given gene?

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

And you can think about that as like an objective rather than a value judgment on the cell.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

I'm not asking whether or not I want this particular transcriptome.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

I'm just asking what it will look like.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

And then we also have something more like, you know, value judgments.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

I believe that that transcriptome looks like a younger cell, and I'm going to select on that and train a head to predict it where I can denoise across genes and then select for younger cells.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

But you could do that for arbitrary numbers of additional heads.

Dwarkesh Podcast
Evolution designed us to die fast; we can change that โ€” Jacob Kimmel

What are some other states you might want?