Akhil Verghese

It's usually binary.

And that's just not the case when it comes to LLMs.

So let's take a really simple example.

Imagine you're an e-commerce company and you want to have an agent that interacts with your customers and lets them do something really simple.

So let's take...

lesson change the date that the order is going to be delivered so i've got an order it's going to be delivered tomorrow i'm not available tomorrow i want you to deliver it the day after

Now, theoretically, right, and not even theoretically, I will put it in writing that modern LLMs can probably one-shot this problem.

I just tell an LLM, hey, someone's going to ask you to do this.

You check that they are editing in order that they have control over.

You check that the day they're asking you to change to is the day that we deliver on.

You check that maybe a few other things you put in the prompt.

And if all of that is a green light, you just go and change it.

That I am 100% certain that that would work at least 99% of the time.

Now, there is not a single enterprise company that I know that would deploy that solution.

And what is the gap, right?

And so what is the solution that an enterprise company would deploy?

Well, what would happen in real life is you would have the person ask the question, you would have a

predictable non-AI based system that verifies who they are, that fetches their order numbers from a SQL query, which is completely structured and deterministic and gets, okay, this is the customer ID.

This is a session key.

These are the orders.