Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Adam Leventhal

๐Ÿ‘ค Speaker
2711 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

But, and then making it open source.

Oxide and Friends
Engineering Rigor in the LLM Age

What was the reception to the, you said these were bugs, these are bugs, confirmed to be bugs.

Oxide and Friends
Engineering Rigor in the LLM Age

So it sounds like what it found was legit.

Oxide and Friends
Engineering Rigor in the LLM Age

All right, so let's actually talk about the first two where you're like, okay, I don't know any Zeg, but like I'm a software engineer.

Oxide and Friends
Engineering Rigor in the LLM Age

I know many other programming languages where you were like, okay, I'm pretty sure that I, just based on its description and me looking at this code, I'm pretty sure that I'm looking at this code.

Oxide and Friends
Engineering Rigor in the LLM Age

I'm pretty sure I've got a legit bug here.

Oxide and Friends
Engineering Rigor in the LLM Age

Could you describe kind of those first two a little bit in terms of like, what did you, I mean, you had confidence.

Oxide and Friends
Engineering Rigor in the LLM Age

You could like, I can actually, not knowing very much Zig or knowing only this Zig I've learned, I think I've got a legit bug here.

Oxide and Friends
Engineering Rigor in the LLM Age

Yeah, yeah.

Oxide and Friends
Engineering Rigor in the LLM Age

I'm so sorry.

Oxide and Friends
Engineering Rigor in the LLM Age

Yeah, okay, so another thing that I think is really interesting is the... And then so Mitchell himself replied to... You've linked all the issues in the chat, so obviously people can get those.

Oxide and Friends
Engineering Rigor in the LLM Age

I think one of the things that I really like about this, David, is that you lead off by saying, like, look, this is... I've been using cloud code with Opus 45 to investigate.

Oxide and Friends
Engineering Rigor in the LLM Age

You're very upfront with, hey, I...

Oxide and Friends
Engineering Rigor in the LLM Age

And LLM has done the work here as a way of saying, someone else is going to need to look at this who's got greater domain expertise.

Oxide and Friends
Engineering Rigor in the LLM Age

Well, and the, but, you know, you obviously quadruple checked all this stuff and it looks like you had, sorry, so this experience, as you said, was, I mean, I like the way you say it was like unsettling.

Oxide and Friends
Engineering Rigor in the LLM Age

When you describe it as unsettling, why was it unsettling?

Oxide and Friends
Engineering Rigor in the LLM Age

Right.

Oxide and Friends
Engineering Rigor in the LLM Age

Right.

Oxide and Friends
Engineering Rigor in the LLM Age

When I do love the fact, you know, like I'm actually even a little bit embarrassed.