Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

Kevin Hartnett

๐Ÿ‘ค Speaker
180 total appearances

Appearances Over Time

Podcast Appearances

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

Great to be here.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

I won't ask the follow-up question.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

Yeah, I mean, virtually everything.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

So like the IMO had been a benchmark for a long time.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

In my book, there's a whole chapter about the previous year's IMO, the 2024 IMO, where Google DeepMind got a silver medal score.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

And that was kind of considered a small watershed.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

And then, as you said, last year, three labs got this gold medal level score, which had really been the kind of the benchmark that had been set out.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

At that point, AI was still just doing essentially high school math, the hardest high school math in the world, but still just high school math.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

And I think for people who never went beyond high school math, it's hard to like really appreciate how far that is from the frontier of research math, like forever far.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

That's like barely even wading into the field.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

It's like 0% of the way to the frontier.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

So it was a proof of concept maybe, but it certainly didn't mean much in terms of can these models actually do research.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

Well, it's definitely both.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

I think the challenge, this IMO Grand Challenge, which was the name that a researcher at Microsoft Research gave to it, was that was really about like, can we just like create models that can do amazing math research?

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

It was just really kind of research for research's sake.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

At a certain point, the labs and these startups you mentioned adopted that challenge themselves and

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

And their motivations were a little different.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

And there's very much this belief that if you can teach a model to reason about math problems and solve math problems, it will be much better at other things.

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

And I always think about this statement, like my high school math teacher would give when people would ask like, why are we learning this?

Hard Fork
Hot I.P.O Summer + What Is A.I. Doing to Math? + HatGPT

What's the point of this?

โ† Previous Page 1 of 9 Next โ†’