Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Rain Paharia

๐Ÿ‘ค Speaker
467 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

So it was three weeks of careful, deep analysis and work and thinking about unsafe and so on.

Oxide and Friends
Engineering Rigor in the LLM Age

And then one day of... I was talking to someone on Blue Sky about this.

Oxide and Friends
Engineering Rigor in the LLM Age

And I think they described it as a pattern amplification machine.

Oxide and Friends
Engineering Rigor in the LLM Age

Right?

Oxide and Friends
Engineering Rigor in the LLM Age

And so you give it a pattern.

Oxide and Friends
Engineering Rigor in the LLM Age

And it just kind of amplifies that pattern into whatever degree you want, right?

Oxide and Friends
Engineering Rigor in the LLM Age

The thing is that before LLMs, I would have probably investigated a code generation library.

Oxide and Friends
Engineering Rigor in the LLM Age

I would have tried out macros or whatever.

Oxide and Friends
Engineering Rigor in the LLM Age

And all of them have some downsides.

Oxide and Friends
Engineering Rigor in the LLM Age

The LLM kind of doing things and tweaking things locally as it went along and like,

Oxide and Friends
Engineering Rigor in the LLM Age

you know, things like for a B-tree map, it'll say like ordered.

Oxide and Friends
Engineering Rigor in the LLM Age

And for a hash map, it won't say that.

Oxide and Friends
Engineering Rigor in the LLM Age

Just like, you know, making sure that the documentation is all aligned and everything.

Oxide and Friends
Engineering Rigor in the LLM Age

It was like, that was my first experience.

Oxide and Friends
Engineering Rigor in the LLM Age

And it was like a great experience where like, it wasn't a one shot, but it was like...

Oxide and Friends
Engineering Rigor in the LLM Age

I want to say like maybe like five or six prompts total.

Oxide and Friends
Engineering Rigor in the LLM Age

And it just kind of just nailed it.

Oxide and Friends
Engineering Rigor in the LLM Age

And so that was my first experience.

Oxide and Friends
Engineering Rigor in the LLM Age

Or the test is testing the wrong thing, right?

Oxide and Friends
Engineering Rigor in the LLM Age

Like they're testing the wrong method or testing the wrong structure or whatever.