Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Adam Leventhal

๐Ÿ‘ค Speaker
2937 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

And all in all, it was really pretty impressive.

Oxide and Friends
Engineering Rigor in the LLM Age

You know, it definitely understood... I mean, it's... We're talking almost here.

Oxide and Friends
Engineering Rigor in the LLM Age

So it's like, this is not... Like, anything that you have trained on that is...

Oxide and Friends
Engineering Rigor in the LLM Age

the Linux kernel or the BSD kernel is like literally not going to apply.

Oxide and Friends
Engineering Rigor in the LLM Age

It would be very easy for you to create arguments to functions that didn't exist.

Oxide and Friends
Engineering Rigor in the LLM Age

I'm talking about the Kstat facility, which is a facility that doesn't exist.

Oxide and Friends
Engineering Rigor in the LLM Age

So it's like, you really cannot rely on something that you've really trained on.

Oxide and Friends
Engineering Rigor in the LLM Age

You're going to have to kind of look at this

Oxide and Friends
Engineering Rigor in the LLM Age

But it was good.

Oxide and Friends
Engineering Rigor in the LLM Age

And I would say like net net, it probably saved me probably about, in terms of like the actual time to implement this, it probably saved me like half the time.

Oxide and Friends
Engineering Rigor in the LLM Age

I spent about two hours on it to have something that was, I was pretty confident would work and did work versus I think it'd probably be about,

Oxide and Friends
Engineering Rigor in the LLM Age

four hours on it.

Oxide and Friends
Engineering Rigor in the LLM Age

And someone's in chat saying, well, how many LLMs train on a Lumos?

Oxide and Friends
Engineering Rigor in the LLM Age

It's like, yes, but what it was, the way it was iterating, and if folks haven't used cloud code, it is really, it's worth experimenting with, especially on an established source base.

Oxide and Friends
Engineering Rigor in the LLM Age

And so one of the things that I would just like to throw out there as like a first way that these things can help increase your rigor is by asking questions about a source base.

Oxide and Friends
Engineering Rigor in the LLM Age

And clearly, like, you know, all of the caveats apply that you can get the wrong answers and so on.

Oxide and Friends
Engineering Rigor in the LLM Age

You need to verify these things.

Oxide and Friends
Engineering Rigor in the LLM Age

But it was really, it made it much more, it figured out a lot of what needed to be done surprisingly quickly.

Oxide and Friends
Engineering Rigor in the LLM Age

So I will absolutely be using it again for other kernel projects, if only to, as a starting point,

Oxide and Friends
Engineering Rigor in the LLM Age

And one thing it did, it was funny, is, Adam, it needed to add a field to a structure.