Andrew Lee
speaker
2,833 appearances
3 recordings
1 series
first heard Mar 2025
last heard 15 May
Andrew Lee’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 2 in all, peaking in May 2026 with 1.
Appearances
And so if, for example, what you want is you really want the LLM to follow a f a flowchart for some portion of
of the project, right?
We could build the ability for you to tell the LLM, hey, you know, during this phase, you must do these steps in order.
And the LLM could actually create its own guardrails and enforce that through code if it wanted to.
So I don't I think if the model is wrapping the code, the model can then construct constraints in those codes to and in that code to enforce the, you know, the reliability goals that you want.
I haven't built it yet, but I think we can.
So um I think
The future's not gonna be, you know, forever.
Here's the the quick, easy unreliable way and then here's the harder, more reliable way.
I th I think it really is gonna be better in basically all scenarios uh in the not too distant future.
Still running on vibes.
Yeah, I think what what we've figured out is in the current
you know, market situation, the anthropic models are the best at what we do.
And there's there's really no question there.
And if you're looking at evals from the standpoint of we're trying to decide whether to roll a full front of the new model, we kind of have no choice, right?
We can't really switch off anthropic right now because there's no viable alternative.
And when a new anthropic model comes out, the pressure from our customers to release that thing as soon as possible is quite tremendous.
Everybody wants it right now.
And so, you know, if we had some evals and the evals, you know, weren't working out the way we wanted.
Um
Showing 841–860 of 2,833 · page 43 of 142
← Previous
Next →