Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Rain Paharia

๐Ÿ‘ค Speaker
467 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

What I ended up doing for, you know, some of the more like the fuzzier signals here was that I basically kind of, you know,

Oxide and Friends
Engineering Rigor in the LLM Age

After it kind of did this work, I would like start a new context window.

Oxide and Friends
Engineering Rigor in the LLM Age

I would feed the guide again.

Oxide and Friends
Engineering Rigor in the LLM Age

And I would ask you to carefully review the, you know, the current PR for conformance with the guide, right?

Oxide and Friends
Engineering Rigor in the LLM Age

And Claude's like, who the hell wrote this?

Oxide and Friends
Engineering Rigor in the LLM Age

And so that ended up finding, you know, a bunch of degrees of freedom, which some of which I wanted and some of which I didn't.

Oxide and Friends
Engineering Rigor in the LLM Age

But that was like that was a good experience.

Oxide and Friends
Engineering Rigor in the LLM Age

I would just do that like two or three times.

Oxide and Friends
Engineering Rigor in the LLM Age

And and then, you know, obviously I would go through and manually review and make sure that, you know, everything kind of aligned.

Oxide and Friends
Engineering Rigor in the LLM Age

But again, like that felt like a very quick process because, you know, I was just I was just able to like, you know, maybe like spend five minutes doing the migration and then another five minutes reviewing it.

Oxide and Friends
Engineering Rigor in the LLM Age

And that was it.

Oxide and Friends
Engineering Rigor in the LLM Age

Right.

Oxide and Friends
Engineering Rigor in the LLM Age

It's wild.

Oxide and Friends
Engineering Rigor in the LLM Age

Someone in chat described it as like using English as a programming language.

Oxide and Friends
Engineering Rigor in the LLM Age

And yeah, I mean, this is basically like, you know, using English as a...

Oxide and Friends
Engineering Rigor in the LLM Age

programming language for programs that are just too hard to write in a deterministic computer language.

Oxide and Friends
Engineering Rigor in the LLM Age

And that's what it felt like doing.

Oxide and Friends
Engineering Rigor in the LLM Age

And I think it's actually kind of remarkable.

Oxide and Friends
Engineering Rigor in the LLM Age

These are the kinds of things that you would absolutely have humans do before the advent of this stuff.

Oxide and Friends
Engineering Rigor in the LLM Age

Or not do.