Justin Johnson
speaker
345 appearances
1 recordings
1 series
first heard Nov 2025
last heard 25 Nov
Justin Johnson’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Nov 2025 with 1.
Appearances
So then he had the paper at twenty C V PR twenty fifteen on the first image captioning results.
Then after that, we started working together and we did a we first we did a paper actually just on language modeling.
Yeah.
Um back in uh twenty fifteen iClear twenty.
fifteen.
Yeah.
Yeah, yeah, I I I should have stuck with language modeling.
That turned out really lucrative in retrospect.
No, but pretty lucrative in retrospect.
But we did this language modeling paper together, um, me and Andre uh in uh twenty fifteen, where it was like really cool.
We trained these little R these little R and N language models that could, you know, spit out a couple of sentences at a time and poke at them and try to understand what the neurons inside the neural network inside the things were doing.
really cool.
And even at that time we had these results where you could like look inside the LSTM and say like, oh, this thing is reading code.
So one of the like one of the data sets that we that we trained on for this one was the the um the Linux source code, right?
Because the whole the whole the whole thing is you know open source and you could just download this.
So we train an RNN on this uh on this data set.
And then as the network is trying to predict the tokens there, then you know, try to correlate the kinds of predictions.
That it's making with the kind of internal structures in the RNN.
And there we were able to find some correlations between, oh, like this unit in this layer of the LSTM fires when there's an open paren and then like turns off when there's a closed paren.
Um, and try to do some empirical stuff like that to figure it out.
Showing 81–100 of 345 · page 5 of 18
← Previous
Next →