Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing
21747 total appearances

Appearances Over Time

Podcast Appearances

The Daily AI Show
The Problem With AI Benchmarks

That's a lot of users in the, and from January, they had 34 million.

The Daily AI Show
The Problem With AI Benchmarks

So up to 132 from 34.

The Daily AI Show
The Problem With AI Benchmarks

Reckon that that's, you know, more than four X, right?

The Daily AI Show
The Problem With AI Benchmarks

Oh, and is with us.

The Daily AI Show
The Problem With AI Benchmarks

That's so good.

The Daily AI Show
The Problem With AI Benchmarks

Well, I hope not to disappoint.

The Daily AI Show
The Problem With AI Benchmarks

Go ahead, Beth.

The Daily AI Show
The Problem With AI Benchmarks

What's your first one?

The Daily AI Show
The Problem With AI Benchmarks

No, no.

The Daily AI Show
The Problem With AI Benchmarks

DeepSeek is a model that you can access through a number of sites, whether Poe or you can just go directly to DeepSeek and use that.

The Daily AI Show
The Problem With AI Benchmarks

So around the world, 132 million people are monthly active users.

The Daily AI Show
The Problem With AI Benchmarks

So within a month window.

The Daily AI Show
The Problem With AI Benchmarks

Compare this to approximately $1 billion using ChatGPT, which is the far and away leader, but DeepSeek is right up there in terms of eight-month interactive users with the second wave crowd of AI models.

The Daily AI Show
The Problem With AI Benchmarks

OK, I'll do another one, which is interesting.

The Daily AI Show
The Problem With AI Benchmarks

AI models, and specifically large language models, are used to do spreadsheets, and now they're becoming more and more competent in doing those kinds of financial analysis-type things.

The Daily AI Show
The Problem With AI Benchmarks

But when you get to the realm of pure mathematics, where mathematicians are working on proofs and developing new theorems in sort of the ethereal world of mathematics, LLMs are not very impressive.

The Daily AI Show
The Problem With AI Benchmarks

And one of the world's biggest mathematicians, a fellow named Joel David Hamkins, has slammed AI models used for solving mathematics and calls them zero and garbage, adding he doesn't find them useful at all.

The Daily AI Show
The Problem With AI Benchmarks

He highlighted AI's frustrating tendency to confidently assert incorrect conclusions and resist correction.

The Daily AI Show
The Problem With AI Benchmarks

They'll argue with him.