Justin Johnson

speaker

345 appearances 1 recordings 1 series first heard Nov 2025 last heard 25 Nov

Justin Johnson’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Nov 2025 with 1.

Appearances

newest first · ▶ plays the moment

Latent Space: The AI Engineer Podcast · After LLMs: Spatial Intelligence and World Models — Fei-Fei Li & Justin Johnson, World Labs · 25 Nov 2025 podcast

So are there like dress just as you know, transformers are

Based around Matmol, and Matmol is sort of the primitive that works really well on GPUs.

As you imagine hardware scaling out, are there other primitives that make more sense for large-scale distributed systems that we could build our neural networks on?

Um and I think it's possible that there could be drastically different architectures that fit with the next generation or like the the the the hardware that's gonna come 10 or 20 years down the line.

And we could start imagining that today.

I mean yes yes and no.

Like if you look at the if you look at the numbers, like even going from hopper to blackwell, like the performance per watt is about the same.

Yes.

Um they mostly make the tr the number of transistors go up and they make the chip size go up and they mo make the the power usage go up.

But even from hopper to blackwell, we're kind of already seeing like a a scaling limit in terms of what is the what is the performance per watt that we can get.

So um that I think I think there are there is room to to do something new.

And I don't know exactly what it is and I don't think you can get it done like

in a three month cycle as a startup.

But I think that's the kind of idea that if you sit down and sit with for a couple of years, like maybe you could come up come up with some breakthroughs.

And I think that's the kind of long range stuff that is a is a perfect match for academia.

C V PR twenty fifteen was the captioning paper.

Yeah, yeah.

I remember the group read the group meeting where Andre was presenting some of those results and explaining this new thing called LSTMs and R and Ns that I had never heard of before.

And I thought like, wow, this is really amazing stuff.

I wanna I wanna work on that.

Showing 61–80 of 345 · page 4 of 18