Mike Knoop
speaker
927 appearances
4 recordings
1 series
first heard Mar 2025
last heard 18 Nov
Mike Knoop’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Nov 2025 with 1.
Appearances
You know, I think what's what's special about arc is that it is a um
It uh the the sort of design uh concept of it is it targets something that's quite straightforward and easy and simple for humans, but hard for AI.
And this is in contrast to every other AI benchmark that exists today, which you're trying to like challenge this like PhD plus plus frontier, you know, like frontier math or you know, humanities last exam.
Uh, you know, these are sort of AI benchmarks that you really do need to be like PhD level plus to be able to even solve as a human.
And in contrast, Arc makes it very
different claim that hey, there's still a lot of like very straightforward for human capability that these frontier AI systems don't have.
Um and so that's why we won Shark Prize.
Uh during the contest, uh the
Think one of the things Arc Prize 2024 will be noted for is probably the introduction of this like test time adaptation method.
That was some of the papers that came out from uh the contest.
We had a big million dollar prize uh in in order to beat the benchmark to get to 85%.
Um, nope, no one did.
Uh, you also have to do it with a very high degree of efficiency.
And we kind of expected that was going to be the case.
So we also had this paper track where people could submit new ideas and push the conceptual forward force, which is where most of the coolest progress came.
out from uh from last year.
Uh and then at the end of the year, obviously last fall, we started seeing things like 01 and 03.
And uh these are this is a very big um this is a very big update, I think, uh, because systems like 01, particularly 01 Pro and things like O3 are not just purely scaling up language models.
These are not language models anymore.
These are really AI systems.
Showing 661–680 of 927 · page 34 of 47
← Previous
Next →