Mike Knoop
speaker
927 appearances
4 recordings
1 series
first heard Mar 2025
last heard 18 Nov
Mike Knoop’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Nov 2025 with 1.
Appearances
Same thing I'm sure you guys saw, you know, in the twenty twenty three, twenty twenty four era.
And so I try to set out to figure out how do I like explain this?
Cause like I have two sets of lived experience that sort of don't match.
And uh this is how I rediscovered uh Francois Cholet's uh Arc benchmark that was originally published in twenty nineteen.
Um and I sort of expected to kind of have gotten kind of beaten by this point, you know, I was first looking into it probably.
Again, 2023, 2024, surprised that it basically hadn't.
And not only hadn't it been beaten, there'd basically been no progress on it.
Uh, which I thought was really fascinating given the fact that we've like scaled up these language model systems by almost like 50,000 times over the last, you know, three, four years prior.
And um so that was kind of the genesis of me uh leading to meeting Francois and kind of pitching with this idea of like, hey, I think this is literally the most important unbeaten AI benchmark in the world.
I think it makes a really important statement that like pre training scaling alone is not sufficient to get to AGI.
And more people should know about this fact.
And so we launched Arc Prize together to try to sort of raise awareness of the benchmark and just honestly inspire more people to work on new ideas again towards AGI.
Yeah.
So when we launched last year, um, you know, like I said, there'd been very little progress uh towards I think GPT four O had was scoring four percent on the benchmark.
Four years in, five years in.
it turned out to be in retrospect quite quite simple.
It's a very uh binary sort of uh fluid re intelligence test.
Um and yeah, like you know, all the knowledge you need to solve this benchmark are doable by you you acquire the knowledge very early on in childhood development.
Um you can take the tasks, in fact, if yourself if you go to arcprice.org.
We have a big player.
Showing 641–660 of 927 · page 33 of 47
← Previous
Next →