Mike Knoop
speaker
927 appearances
4 recordings
1 series
first heard Mar 2025
last heard 18 Nov
Mike Knoop’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Nov 2025 with 1.
Appearances
This test time compute is another form of of what we're talking about here.
So I was twenty twenty-four.
One of the big things we're seeing on products twenty twenty five is this concept of refinement loops.
Um, anywhere where, like, particularly with like language models being put into outer outer loops where they can sort of move from state to state.
And how they move from state to state is like they need to make some sort of refinement on the program or the natural language explanation of the task that they're working towards.
Um, and they just iterate on this like refinement loop over and over.
Uh, and this is significantly increasing scores, even over the sort of test time fine-tuning stuff that we saw from from last year.
So Jer Jeremy Burns.
And Eric Pang were two folks who were on the public leader board last month uh that uh explained how their approach worked in this way.
Um so we're seeing a lot of approaches like that.
Um I still think we're in a regime though where like we still need new ideas.
Uh none of these are sort of sufficient to solve ARC, um, including inclusive of V1.
Um, and so like.
You know, I this gets me excited because I still think that means individual people, individual teams with small budgets, small compute budgets, um, can still play a really, really massive role in advancing AI.
I think it's um
All all of those examples of new research, new companies, new startups, like that you know, there was this there was a seismic shift in twenty twenty five from pre-training budget to uh these like RL reinforcement learning environment uh startups and companies that are generating environments to produce
uh more ground truth training data in a mass way because they're you know automated environments and you can get verified feedback signals out of these things.
again, no there's no new science here.
Like this is a good bet for like all Frontier labs to make.
This is going to drive progress for the next twenty-four to thirty-six months.
Showing 201–220 of 927 · page 11 of 47
← Previous
Next →