Josh McGrath
speaker
251 appearances
1 recordings
1 series
first heard Dec 2025
last heard 31 Dec
Josh McGrath’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Dec 2025 with 1.
Appearances
Like in some ways of order of magnitude or I don't know if we could do order of magnitude, but if you think about like pre-training, you know, you're moving tokens to many machines and then you're getting like a basically a scalar from them, and then you're backpropping.
Yeah.
The issue with RL is like you're doing tasks, and each task could
have like a a different grading setup.
And each one of those different grading setups, that's like more infrastructure.
And so, you know, when I'm staying up late trying to figure out what's going on with a run, it could be in way more things than there's in a pre-training run generally.
Honestly, I don't think I'll comment like too much on like how many external partners
Yeah, there
of like well
Shit, like I don't own this code.
Okay, you know.
So well, when it comes to I don't own this code, actually, like when, you know, when I'm babysitting a run or something, it doesn't really matter if it's like internal, external, whatever.
Like, do I understand the system that's going underneath?
And I think you end up having to like.
jump into a lot more code that you're like, I actually don't know what this does.
Because like I'll be watching the, you know, I I work on my pieces of a run.
Um and then there's also, you know, other people working on it.
And like, do I understand what their code is doing?
So at that way at like twelve thirty in the morning when I'm like something looks wrong and it's I'm like looking at this code, can I like get context fast enough to understand the thing wrong?
Oh, I use codecs so much.
Showing 21–40 of 251 · page 2 of 13
← Previous
Next →