Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Rain Paharia

๐Ÿ‘ค Speaker
467 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

It would be a couple of weeks of work at least, and it would be pretty hard for me to justify that work as opposed to just ambling along with the default maps.

Oxide and Friends
Engineering Rigor in the LLM Age

But then I really also wanted to get this in the hands of my coworkers because I'm actually really excited about this pattern.

Oxide and Friends
Engineering Rigor in the LLM Age

So what I ended up doing was that I ended up handwriting one of the maps.

Oxide and Friends
Engineering Rigor in the LLM Age

And then I told, I think back in the day, it was like Sonnet 4.1 or something, right?

Oxide and Friends
Engineering Rigor in the LLM Age

So this was, you know, we were like a couple generations before, right?

Oxide and Friends
Engineering Rigor in the LLM Age

Right, right.

Oxide and Friends
Engineering Rigor in the LLM Age

And so I just told it to kind of replicate, you know, the same APIs across all of the other maps, right?

Oxide and Friends
Engineering Rigor in the LLM Age

It just nailed it.

Oxide and Friends
Engineering Rigor in the LLM Age

There were local differences to things that adapted the map types to those differences.

Oxide and Friends
Engineering Rigor in the LLM Age

I want to see a total of around 20,000 lines of code.

Oxide and Friends
Engineering Rigor in the LLM Age

Then I asked it to generate doc tests.

Oxide and Friends
Engineering Rigor in the LLM Age

One of the things you should do, if you look at say the Rust core types, you will see that every method has a doc test associated with it.

Oxide and Friends
Engineering Rigor in the LLM Age

I wanted to get that rigor where every method has a doc test associated with it.

Oxide and Friends
Engineering Rigor in the LLM Age

I don't know about you, but I hate writing 5,000 lines of doc tests.

Oxide and Friends
Engineering Rigor in the LLM Age

I just told the LLM to do that.

Oxide and Friends
Engineering Rigor in the LLM Age

I gave it a couple of examples to start with, and I just told Sonnet 4.1, I think, to do that.

Oxide and Friends
Engineering Rigor in the LLM Age

It just replicated the things that it wrote like thousands of lines of doc tests.

Oxide and Friends
Engineering Rigor in the LLM Age

This work that I'd been dreading because it would be weeks of work,

Oxide and Friends
Engineering Rigor in the LLM Age

It took me, I want to say, less than a day to get the whole thing ready.