Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Rain Paharia

๐Ÿ‘ค Speaker
467 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

And so, you know, you update the server first and you have like this DAG of,

Oxide and Friends
Engineering Rigor in the LLM Age

dependencies that you update.

Oxide and Friends
Engineering Rigor in the LLM Age

It's just like this, you know, really well-constructed system.

Oxide and Friends
Engineering Rigor in the LLM Age

It's pretty great, right?

Oxide and Friends
Engineering Rigor in the LLM Age

So one of the issues we ran into is that as we gained experience with the system, we were having trouble figuring out how, like, you know, you have all these different versions.

Oxide and Friends
Engineering Rigor in the LLM Age

And so you have, like, a type, right?

Oxide and Friends
Engineering Rigor in the LLM Age

And that type has the same name, but it has different, like, fields, for example.

Oxide and Friends
Engineering Rigor in the LLM Age

Or, like, you know, maybe one of the subfields is different.

Oxide and Friends
Engineering Rigor in the LLM Age

And so...

Oxide and Friends
Engineering Rigor in the LLM Age

How do you actually store those in the repo?

Oxide and Friends
Engineering Rigor in the LLM Age

It sounds like a simple problem, but this actually blows up and becomes this incredibly complicated problem with many different factors involved.

Oxide and Friends
Engineering Rigor in the LLM Age

Again, this is one of those things where it's like this combination of human and LLM work where I spent a bunch of time prototyping a bunch of things and coming up with an approach that works and that satisfies all of the hard constraints and also as many of the soft constraints as we can.

Oxide and Friends
Engineering Rigor in the LLM Age

And, and so, you know, this was like a lot of work.

Oxide and Friends
Engineering Rigor in the LLM Age

And then, um, one of the, one of the interesting things that I found really useful for LLMs is that what I did was I ended up essentially like compiling the set of things that, you know, the final state we want to get to and like writing it out as a set of instructions that

Oxide and Friends
Engineering Rigor in the LLM Age

both a human and an llm can follow and so in this guide uh that i dropped a link to uh this is rft 619 and in this guide it is in section um 5.1 and so this 5.1 is kind of this initial migration right and so again like you know spent like a couple weeks working on this on on like this whole rft

Oxide and Friends
Engineering Rigor in the LLM Age

And then what I did was like, okay, you know, I'm like, I just kind of fed this guide into the LLM and, you know, I told it to like migrate a small repo, right.

Oxide and Friends
Engineering Rigor in the LLM Age

One of the, one of our smaller APIs.

Oxide and Friends
Engineering Rigor in the LLM Age

And it just did that in one shot.

Oxide and Friends
Engineering Rigor in the LLM Age

So this was like, you know, not a very big API.

Oxide and Friends
Engineering Rigor in the LLM Age

It just did that.