Corey Noles

I think it's a good app that's really good for coding, but it's also good for just using it with files on your computer.

But yeah, this is a great resource for people.

It also pulls from the official Codex docs and other stuff.

So it's like a great starting point if you've never used these tools before and you want to do what Dan did, which is build an app and produce it and hopefully not skip the best practices and not sleep for seven days.

Yeah.

yeah um but yeah it's a great resource that you published um what else happened yesterday yesterday the arc prize we were oh this was the other thing i wanted to ask dan about um was benchmarks because you and i were having a discussion right before we got on here about the value of benchmarks and whether or not they're useful and we can save everyone the back and forth between you and i but i think your

ultimate conclusion makes sense to me which is benchmarks are toast like they're cooked and the only benchmark that really matters is a list of tasks that the ai can accomplish and you just list every human task you can think of and just mark off and i don't care what you connected to to get there i don't care if you're doing that in cloud code i don't care if you're doing it through an api but i think if there's a thing it can accomplish that is really good we should see that

And I feel like I'm behind.

But then I compare what I know to the average person.

And oh, my goodness.

People are not prepared.

So for anyone who's watching, I don't even know how many people are still on the stream at this point, but for anyone who's watching, this is the Arc AGI 3 test, and basically it's a series of video games that test your ability to...

uh reason and adapt to a new situation figure out the rules of the situation and then um basically uh try to solve this puzzle and i have failed this one three times because i missed a key thing there oops but now i got it and i'm gonna try this is kind of hard but yeah go ahead

Okay.

Well, that's – it is what it is.

Yeah, that makes sense.

Yeah, because I was like, really?

You just feel awful quiet.

Nobody has any feedback?

No, that makes sense.