Josh McGrath
speaker
251 appearances
1 recordings
1 series
first heard Dec 2025
last heard 31 Dec
Josh McGrath’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Dec 2025 with 1.
Appearances
Um I'm guessing that both things will will sort of happen just because we wanna put as much power into the models as possible.
Yeah.
Yeah, I I think we're still in a period where we should all be expecting changes in the the interfaces that all of the models give to us.
Um that way we can improve the models.
Cause if we lock the interface, I think what would be sad from from my perspective is if we lock the interface, if we discover something new about models, we might sort of trap that improvement under a an interface that needs to change.
Um, no, it's not an impossible dream.
Uh I think I'll give a shout out to some of the evals that we did for four point one with uh called Graph Walks where I love Graphlocks.
Yeah, yeah, yeah, we did.
And you know, I think if you look over time, all of those uh all of those evals are are still climbing.
And I think one of the interesting things about that is you have to do complicated transformations across the entire context window.
Like that's sort of the issue with um those heat map plots of the those different hash.
Yeah, but the problem is if you only have to sample from one point in the context window, it's like sort of easy, whereas
with those graph walks problems, you're having to do multiple transformations across the entire context window.
Um, and so I think keep watching those.
I think they've they've been climbing, they'll continue to climb.
I would say that that's definitely like a temporary issue that we are
Climbing on over time.
That's fair.
I guess the so I would still say, like, I don't know, but I think I've been like really surprised.
It reminds me of when I was doing like more information retrieval stuff and like uh BM25 and these like very simple like Ngram indexes were like just super hard to beat.
Showing 161–180 of 251 · page 9 of 13
← Previous
Next →