Joe Weisenthal

I mean, there are some really- All right, let me caveat that.

Up until recently, there was one chart of a line going up exponentially that became, I think it's fair to say, the most viral chart in AI, right?

Yes, I would absolutely agree with that.

So one of the many lines that go up, and there are various lines that sort of capture this, is essentially just measures of AI progress of what they can do, what the models are capable of, and so forth.

And there's all different benchmarks out there, and hobbyist benchmark creators, et cetera, all kinds of benchmarks out there.

Organization called Meter, based out in

san francisco and they measure how well ai models are doing at various sort of engineering tasks etc and they have these charts showing how long you know certain tasks how long it would take a human to do them and then whether ai could do them and yes the lines just almost vertical i think there was someone like one of the ones that came out maybe very early this year or late last year showing the latest claude modeling

This is crazy.

Yeah.

Can I say one other thing, too, that I'm very curious about?

I'm really glad that there are people designing various benchmarks for measuring AI progress.

Seems like an important thing to get a handle on.

But if I were, say, talented or smart enough to be doing these things, I would go work for one of the labs and make $10 million a year or something like that.

And so I'm actually curious because a lot of nonprofits, et cetera, it's like,

Do you really want to be working at the cutting edge of AI in a nonprofit?

I mean, I guess open AI is owned by a nonprofit, weirdly enough.

But you know what I'm saying?

Like, I would want the money.

That's exactly right.

Exactly right.