Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

David Crespo

πŸ‘€ Speaker
169 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

So I, I looked into them and I just have Opus essentially figure out, I, you know, the only thing I really had to do was find the rust port of mini dump stack walk to like, look at the, at the crash dump.

Oxide and Friends
Engineering Rigor in the LLM Age

And, um,

Oxide and Friends
Engineering Rigor in the LLM Age

pointed at the problem and, and, and I knew where the crash dump was located on my desk.

Oxide and Friends
Engineering Rigor in the LLM Age

And then from there, it basically was able to like look at the code, statically analyze it and find the source of these of, I found three different bugs this way.

Oxide and Friends
Engineering Rigor in the LLM Age

Um, real.

Oxide and Friends
Engineering Rigor in the LLM Age

And then these, I was able to write up the bug reports and they were confirmed to be real bugs and, and, and fixed.

Oxide and Friends
Engineering Rigor in the LLM Age

And I, so that was what really unsettled me was that this was an area where I really knew nothing.

Oxide and Friends
Engineering Rigor in the LLM Age

And just using my sort of like sense of what sounds like it makes sense to validate that I wasn't going to be posting AI slop on the ghosty GitHub.

Oxide and Friends
Engineering Rigor in the LLM Age

Um,

Oxide and Friends
Engineering Rigor in the LLM Age

I was able to come to, you know, three real bug reports without really putting very much into the process.

Oxide and Friends
Engineering Rigor in the LLM Age

There was no lively bugging.

Oxide and Friends
Engineering Rigor in the LLM Age

I think it was looking at the stack trace and then looking at the code that, and you know, the, the, the error that came up and then just sort of thinking about what the, what could have happened in the code to cause the error.

Oxide and Friends
Engineering Rigor in the LLM Age

Yeah, you know, part of it was that, you know, the bug report itself was even to some extent out of my depth.

Oxide and Friends
Engineering Rigor in the LLM Age

Like a couple of them I was really confident.

Oxide and Friends
Engineering Rigor in the LLM Age

And then one of them I was like, it sounds really good, but I just wasn't able to, you know, I didn't know enough about how Ghosty worked or how Zig worked to really evaluate.

Oxide and Friends
Engineering Rigor in the LLM Age

So I was nervous, but I was, you know, up front with a lot of humility of like, I'm really not sure about this, but it sounds so good that I cannot hold it back.

Oxide and Friends
Engineering Rigor in the LLM Age

Yeah, one of them was very simple because it was like a copy paste error where they were just referring to the wrong variable.

Oxide and Friends
Engineering Rigor in the LLM Age

And you could tell, you know, it was supposed to be grapheme bytes and it was hyperlink bytes, you know, and you could tell that that was, so it was like, okay, that sounds pretty straightforward.

Oxide and Friends
Engineering Rigor in the LLM Age

Another one.

Oxide and Friends
Engineering Rigor in the LLM Age

This was like two months ago, so I can't.