Sholto Douglas

What I was thinking about after the Vesuvius Challenge was like,

Wait, I knew, like, Nat had told me about it before it dropped because we recorded the episode before it dropped.

Why didn't he, why did I not even try?

Like, I don't know.

Like, Luke is obviously very smart and, like, yeah, he's an amazing kid.

But, like, he showed that, like, a 21-year-old on, like, some 1070 or whatever he was working on could do this.

I don't know, I feel like I should've.

So you know what, before this episode drops, I'm gonna meet my, I'm gonna try to- Dorkesh, we're gonna make an interpretability research video.

No, no, no, I'm not gonna try to make a research video.

I don't know, it's like, I was honestly thinking back on experience, like, wait, I shouldn't, like, why didn't I do, fuck.

Maybe your hand's dirty.

um oh i want to harp back on this like the neuron thing you said i think a bunch of your papers have said there's more features than there are neurons and this is just like wait a second um

I don't know, like a neuron is like weights go in and a number comes out.

That's like a number comes out.

You know what I mean?

Like that's so little information.

Do you mean like there's like street names and like species and whatever?

There's like more of those kinds of things than there are like a number comes out in a model?

That's right, yeah.

But how is it a number comes out as like so little information?