Josh McGrath

speaker

251 appearances 1 recordings 1 series first heard Dec 2025 last heard 31 Dec

Josh McGrath’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months

Recordings per month over the last 12 months — 1 in all, peaking in Dec 2025 with 1.

Appearances

newest first · ▶ plays the moment

Latent Space: The AI Engineer Podcast · [State of Post-Training] From GPT-4.1 to 5.1: RLVR, Agent & Token Efficiency — Josh McGrath, OpenAI · 31 Dec 2025 podcast

Like I think

That's something that we think about a lot just because it contributes so much to your experience.

Like how long does it take to do this task?

Yeah.

And I think the other thing is as you're pushing that token efficiency, it changes, you know, how many tool calls can I make and like how many different things can the agent do in a reasonable number of tokens that we can actually serve.

Um so I personally think in terms of tokens, yeah.

Yeah, and I think, you know, we'll figure out the correct abstractions over time.

I think like there's a is

Yeah, I think like eventually, you know, we'll have uh AGI and like you're not gonna have to worry too much about how hard to to think directly.

It'll just, you know, we'll have a one tool that you always go to and it knows how long to think for and things like that.

I think the the abstractions and the way that we drive these things today, it it'll change.

And like, you know, I think even the amount that we've changed from, you know, having a nom thinking model to you can choose between two and like, you know

So now we can sort of route and how hard do you want to think?

We're adding lots of knobs and you know, uh eventually it'll it'll probably simplify it.

Uh nothing to share at the moment.

Okay.

Oh, uh, I see.

Uh, you know, I don't know.

I worked on long context, that was why I was on last was for four point one where we, you know, I think ten X the the effective context window for four point one.

And so there'll always be some dance of like, Well, if we wanna push as much as what we can do, not only should we increase the length of the context window, but like we should also have strategies for keeping that context window available for as long as possible.

Showing 141–160 of 251 · page 8 of 13