Eiso Kant
speaker
1,158 appearances
1 recordings
1 series
first heard Jul 2026
last heard 23 Jul
Eiso Kant’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
You think about the notion, and we're seeing this in inference, the pre-fill and decode
Yeah.
Just work better with, you know, a general purpose and a GPU and a more specialized like chip, right?
Like the Grok chip at NVIDIA, the LPU and the GPU combined.
And there's different versions of that in the industry.
And RL is batch size constraint, right?
So like you are ultimately in your batch size constraint because you don't have infinite tasks, right?
When you've got the entire web, you can be much more flexible in scaling up your batch size because you've got the entire web.
But for RL, you have, you know, X millions of tasks that you are going to be training on.
And so you cannot blow up your batch size massively, which means that you actually can't scale compute to a certain extent with RL the same way you could scale compute with like pre-training.
And so I'm very excited about anything that improves that.
And I think one of the best ways to start improving that is the things that we're already starting to see in inference, which is the separation of the pre-fill and decode to different chips to come to reinforcement learning, right?
And I think we'll be there soon.
And I think more people should be working on this because then all of a sudden we're able to just be way more efficient in how we train RL from all clock time.
Again, coming back down to the fact that it's a race, right?
The race is measured not in how many GPUs, but the race is measured on calendar time.
And that's probably one of the biggest impacts we can have right now to speed up our industry.
And so that's one like technically I love geeking out about and talking to people.
Yeah.
No, look, I think it's, I think more innovation in space is just like, is the coolest thing.
Showing 1001–1020 of 1,158 · page 51 of 58
← Previous
Next →