Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Rain Paharia

๐Ÿ‘ค Speaker
467 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

I think I would expect myself to write a bug report.

Oxide and Friends
Engineering Rigor in the LLM Age

So again, I am biased towards optimism here, but it is something I'm worried about.

Oxide and Friends
Engineering Rigor in the LLM Age

I do look at people just putting up garbage and it's like, okay, well, it's now harder to filter out garbage.

Oxide and Friends
Engineering Rigor in the LLM Age

I have to say on the flip side, a thing I've done is I've used Opus 4.5 and fed it a bug report and told it to tell me whether this bug report is real or not.

Oxide and Friends
Engineering Rigor in the LLM Age

Maybe that's the way to keep up.

Oxide and Friends
Engineering Rigor in the LLM Age

I believe it comes from Facebook, by the way.

Oxide and Friends
Engineering Rigor in the LLM Age

I know Facebook had an internal scale vibe and then someone built an external version.

Oxide and Friends
Engineering Rigor in the LLM Age

And I mean, it's the Facebook culture.

Oxide and Friends
Engineering Rigor in the LLM Age

Like it is exactly the kind of thing that you would expect Facebook to make.

Oxide and Friends
Engineering Rigor in the LLM Age

And so, you know.

Oxide and Friends
Engineering Rigor in the LLM Age

I actually have an example of a bug that I feel like I would have just ignored in the past, but had a much better time with Opus 4.5.

Oxide and Friends
Engineering Rigor in the LLM Age

And so this is a bug on, you know, on Cargo Next Test, which is a personal project.

Oxide and Friends
Engineering Rigor in the LLM Age

And the bug is titled sigttou when test spawns interactive shell.

Oxide and Friends
Engineering Rigor in the LLM Age

Now, if you've spent any time on this stuff, you're like, my eyes glazed over pretty much, right?

Oxide and Friends
Engineering Rigor in the LLM Age

And so it's like, okay, you know, this person actually did a nice investigation with Claude and kind of posted this and said that they, I've worked with Claude to get good attribution for this and reproduction.

Oxide and Friends
Engineering Rigor in the LLM Age

It wrote the words below, but I stand behind them, right?

Oxide and Friends
Engineering Rigor in the LLM Age

And so it was like a pretty well-written issue, but you know, it's the sort of thing that I really would want to dive in to like, you know, it kind of gave an example of like, you know, this is used by all these other projects.

Oxide and Friends
Engineering Rigor in the LLM Age

And so you should do this thing as well.

Oxide and Friends
Engineering Rigor in the LLM Age

And it is like, it is one of those, um,