Jyunmi

But what we're seeing, I just wanted to point out, and I'm in total alignment with you, Carl, the thing with the benchmarks is this is how tech does its assessments or tries to push itself initially.

Does anybody remember the CPU megahertz, gigahertz wars, right?

Cycles.

It's like, oh, well, this Pentium came out with a thousand megahertz.

Well, this came out with 1.4 gigahertz, right?

But that didn't say anything about what the actual result was.

And so I think a lot of people are getting to the point, or at least within our larger bubble here, is it comes down to the use cases and what's the actual output.

Like, for example,

Right now, all the models are different enough in what they're the best at to where you kind of want to use them all

in the right use case or at least use them in conjunction with each other.

Like I just saw about an open source project that was tied them all up into sort of like a council of experts kind of situation where you could

you'd have your orchestration, you would send it off to, your query would be then determined who would, which model would this best fit for.

Everyone would answer and then they would, then they would deliberate on what the answer was and seek alignment through that process, right?

So sort of the mechanisms that's already happening within each model, but now amongst all of these two separate models.

But that kind of goes back to what I was talking about in terms of it really is what,

What kind of use case am I going to go for?

If Gemini is better at assimilating dozens of documents and huge amount of context and then being able to distill that into a more compact form, and then I need to turn that into a coding project and putting that into quad for coding.

And if that coding then needs another model to generate a creative thing, then I'm going to use that.

And so I think we're still at the point where there isn't a, okay, I'm going to be in the Claude camp or I'm going to be in the Gemini camp or OpenAI camp and that's all I'm going to use.

uh because even from even if we were using the benchmarks that uh what andy showed us showed clear different sections of what is being tested reasoning versus agentic coding versus you know creativity or or whatnot and each model seemed to or each grouping of models seem to be better at one section or another so yeah i i'm with you carl i don't think um