Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing

David Crespo

πŸ‘€ Speaker
169 total appearances

Appearances Over Time

Podcast Appearances

Oxide and Friends
Engineering Rigor in the LLM Age

It doesn't know that the test pass, doesn't know that CI passes.

Oxide and Friends
Engineering Rigor in the LLM Age

But you can get quite a lot that way.

Oxide and Friends
Engineering Rigor in the LLM Age

It can find a mismatch between your SQL migration and your main code.

Oxide and Friends
Engineering Rigor in the LLM Age

DB init sequel I can find inconsistencies really well and inconsistencies even between like your human readable stuff like your PR description and the actual code There's a lot you can do there even without net what we now have which is like the tools that can go and vacuum up anything that they need to and to validate their hypotheses about why the PR is broken and

Oxide and Friends
Engineering Rigor in the LLM Age

With Cloud Code, it can write a new test that validates that the code as written doesn't do something.

Oxide and Friends
Engineering Rigor in the LLM Age

And there's a lot of low-hanging fruit there that we're not really touching at all.

Oxide and Friends
Engineering Rigor in the LLM Age

Hmm.

Oxide and Friends
Engineering Rigor in the LLM Age

I've been thinking a lot about this because if you think about where our intuitions come from about what is worth abstracting or what is too much repetition, they're so tied up with the expected reader of the code, whether that's ourselves or the people that we know.

Oxide and Friends
Engineering Rigor in the LLM Age

They're tied in very, very tightly with our intuitions about what people can handle and what's reasonable to expect of other people.

Oxide and Friends
Engineering Rigor in the LLM Age

And what is reasonable to expect of an LLM is radically different from what is reasonable to expect of other people.

Oxide and Friends
Engineering Rigor in the LLM Age

And so the amount of repetition that is tolerable in a code base or is manageable seems to me way higher.

Oxide and Friends
Engineering Rigor in the LLM Age

And it's not just in a code base.

Oxide and Friends
Engineering Rigor in the LLM Age

We were thinking about API design, API response shapes earlier, and I was working with Adam on this, that we erred on the side of making a response shape more flat and less nested, even though we lost a little bit of type information that way, just because the flat one was a little easier to read, and the type information we decided was not really worth it keeping in that particular case.

Oxide and Friends
Engineering Rigor in the LLM Age

But I think...

Oxide and Friends
Engineering Rigor in the LLM Age

When you assume that future developers will have LLMs at their disposal, I think that it must tilt the calculus toward encoding more type information at the expense of readability, because that type information is what is going to keep LLMs on the rails in the future.

Oxide and Friends
Engineering Rigor in the LLM Age

and just say if a more elaborate type system lets you put more of that work in upfront to sort of constrain the program further,

Oxide and Friends
Engineering Rigor in the LLM Age

you could say that LLMs allow you to tolerate an even more elaborate type system.

Oxide and Friends
Engineering Rigor in the LLM Age

Maybe now dependent types are going to be feasible for people to learn and work with.

Oxide and Friends
Engineering Rigor in the LLM Age

Maybe you'll see Idris take off.

Oxide and Friends
Engineering Rigor in the LLM Age

Yeah.