Grant Harvey

But I will say I kind of respect that with a situation like NPM where, you know, it just got hacked with Shilud.

And I almost now I'm like, I don't want to use anything with NPM, you know, as an amateur vibe coder.

Yeah, for sure.

Yeah.

Yeah.

But it is interesting that they're like, yeah, I'm just going to do it myself instead of going for the most direct, most obvious answer.

Yeah.

That makes sense.

What about harnesses, I guess?

Because we were hearing a lot about harnesses in the context of agents, and we're wondering... And benchmarking.

Yeah, if it's worth companies building their own versus something off the shelf.

I mean, do you have any insight into that and your perspective there?

So why are eval sets so hard to create?

I was going to say, you should hire me then because I feel like I'm a very lazy, clever person.

So I feel like I would try to find the easiest way to do stuff.

Technically it passes, yeah.

It did what you told it.

I know which one you're talking about.

I like that.

What's your recommendation for someone who, you know, needs is maybe starting to build their own evals and assess things like what what's what do you do or what's your perspective on the best way to eval or write evals, I guess?