Justin Johnson
speaker
345 appearances
1 recordings
1 series
first heard Nov 2025
last heard 25 Nov
Justin Johnson’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Nov 2025 with 1.
Appearances
So the amount of compute that we can marshal today on on a single model is is, you know, about a million fold more than we could have even at the start of my PhD.
So I think language was one of the really um one really interesting things that started to work quite well the last couple of years.
But as we think about moving towards visual data and spatial data and world data, you just need to process a lot more.
And I think that's gonna be um a good way to soak up this uh this new compute that's coming online more and more.
even before grad school, like I wanted to do computer vision and I reached out to a team at Google and like wanted to I'd potentially go and try to do computer vision like out of out of undergrad.
And they told me like what what are you talking about?
Like you can't do that.
Like go do a PhD first and come back.
that
Oh so advice I I done some computer vision research in uh during my undergrad with uh with actually Fei Fei's PhD advisor.
the I had done some computer vision even as an undergrad and I thought it was really cool and I wanted to keep doing it.
Um so then I I was sort of faced with this sort of industry academia choice even coming out of undergrad that I think a lot of people in the research community are facing now.
Um, but but to your question, I I think like the role of of academia at especially in AI has shifted quite a lot in the last decade.
Um and it's not a bad thing.
Um it's it's a sense of it's it's because the technology has has grown and emerged, right?
Like five or ten years ago, you really could train state of the art models in the lab, um even with just a couple of GPUs.
But you know, because that technology was so successful and scaled up so much, then you you can't train state of the art models.
With a couple GPUs anymore.
And that's not a bad thing.
It's a good thing.
Showing 21–40 of 345 · page 2 of 18
← Previous
Next →