Mike Knoop
speaker
927 appearances
4 recordings
1 series
first heard Mar 2025
last heard 18 Nov
Mike Knoop’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Nov 2025 with 1.
Appearances
I I so if I kind of lay out in tease here kind of the version we're doing a public preview for today, um, you know, we've got V Arc V1, V2, and V3, V1 was introduced back in 2019.
It was designed to challenge deep learning as a paradigm.
Remember, this is before language models, years before sort of language models really hit any sort of stride in terms of the research.
Um, and it uh sort of was robust through that uh advancement.
And that's because language model sort inherits some of the same fundamental limitations that pure deep learning do.
Mm-hmm.
V2 was designed to challenge this new paradigm of AI reasoning systems.
Um, it's still a static benchmark, so the puzzles look very similar to v1.
It might actually be kind of surprising that like you can't beat v2 if you can beat v1 because they look like they're in domain from each other.
But totally the the intuition here is generally the v2 puzzles.
require um longer reasoning chains generally to solve them.
And so that gets harder to do.
Um one of the things that we started to see though this year is really the emergence of a lot of these agent systems that are being placed into dynamic, open-ended environments.
And while static reasoning, I think benchmarks are useful and will continue to be useful.
Um, this is one of the motivations for starting to build um B3 and defining what we're calling an interactive reasoning benchmark to help evaluate and really challenge some of these frontier AI agent systems we're starting to see uh emerge.
Give us the overview.
it's a little unique for us because you might be surprised, like, oh wait, V three's launching, didn't V two launch like three months ago?
Uh yes, yes.
Today's a public preview.
We're we're showing off the first three public games from the eventual data set.
Showing 321–340 of 927 · page 17 of 47
← Previous
Next →