Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Adam Leventhal

๐Ÿ‘ค Speaker
2937 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

Yeah, interesting.

Oxide and Friends
Engineering Rigor in the LLM Age

So, yeah, a bunch of follow-up questions.

Oxide and Friends
Engineering Rigor in the LLM Age

So that's really interesting.

Oxide and Friends
Engineering Rigor in the LLM Age

So one, I mean, this is the kind of tedium that you do.

Oxide and Friends
Engineering Rigor in the LLM Age

Just like you say about the doc tests.

Oxide and Friends
Engineering Rigor in the LLM Age

We all know the doc tests are great.

Oxide and Friends
Engineering Rigor in the LLM Age

As a user of something, you really appreciate them.

Oxide and Friends
Engineering Rigor in the LLM Age

It just takes a lot of time to get that working correctly.

Oxide and Friends
Engineering Rigor in the LLM Age

It's really easy when you, as a human arc, I mean, like bluntly cutting and pasting, right?

Oxide and Friends
Engineering Rigor in the LLM Age

When you are cutting and pasting.

Oxide and Friends
Engineering Rigor in the LLM Age

Yeah.

Oxide and Friends
Engineering Rigor in the LLM Age

It's super easy to make a mistake where it's like, oh, that doc test, by the way.

Oxide and Friends
Engineering Rigor in the LLM Age

Have you looked at the doc test?

Oxide and Friends
Engineering Rigor in the LLM Age

Like that actually, you just cut and paste it.

Oxide and Friends
Engineering Rigor in the LLM Age

You changed it in two places, but not the third.

Oxide and Friends
Engineering Rigor in the LLM Age

And so now like what you have is kind of nonsense in the test.

Oxide and Friends
Engineering Rigor in the LLM Age

Like, well, that's not very good.

Oxide and Friends
Engineering Rigor in the LLM Age

So easy to make a mistake.