Menu
Sign In Search Podcasts Libraries Charts People & Topics Add Podcast API Blog Pricing
Podcast Image

The Digital Executive

Akhil Verghese: Why AI Needs Guardrails | Ep 1263

08 Jun 2026

Transcription

Transcript generated automatically by AI and may contain errors.

Chapter 1: What is the main topic discussed in this episode?

8.789 - 28.639 Brian Thomas

Welcome to Corozant Technologies, home of the Digital Executive Podcast. Do you work in emerging tech, working on something innovative, maybe an entrepreneur? Apply to be a guest at www.corozant.com forward slash brand. Welcome to the Digital Executive. Today's guest is Akhil Verghese.

0

28.659 - 49.174 Brian Thomas

Akhil Verghese is the visionary founder, leader of Krasimo, steering the company's mission to bring reliable enterprise-grade generative AI to the market. With a background that includes engineering experience at one of the tech's strongest firms, he founded the company to deliver AI solutions built on engineering rigor, clarity of workflow, and measurable business outcomes.

0

49.154 - 68.192 Brian Thomas

Under his leadership, Krasimo focuses on guiding businesses through AI adoption, creating multi-step workflow automation, deploying multi-agent systems based on retrieval augmented generation, or RAG, and executing rapid full-stack AI-assisted development. Well, good afternoon, Akhil. Welcome to the show.

0

Chapter 2: What inspired Akhil Verghese to found Krazimo?

68.653 - 84.89 Brian Thomas

Thank you so much for having me, Brian. You're very welcome. I appreciate it. And I know you're currently in London. So jumping some time zones, some calendars here is always a challenge. So thank you. I'm in Kansas City. So Akhil, if you don't mind, let's jump in to your story here with your journey.

0

84.93 - 97.926 Brian Thomas

You just described taking a fairly meandering path into AI with stops that include IBM consulting and several years as an engineer at Google. How did that path eventually lead you to found Cresmo?

0

97.906 - 115.602 Akhil Verghese

Honestly, meanderingly, if that's even a word, pretty much sums it up. I started my first machine learning projects when I was working at IBM, even though that wasn't my primary role. And then later on, I was with a bunch of people in San Francisco and we tried to co-found a company there. was an intelligent assistant for your office.

0

116.083 - 132.925 Akhil Verghese

Unfortunately, this was before the transformer paper and before large language models. So it was running on a technique called LSTMs and recurrent neural networks. And they weren't really able to keep context over large document sizes and things like that. So it didn't really work out that well. But

0

132.905 - 141.553 Akhil Verghese

Through my time at Google, I started working towards the tail end of it on applications of AI on more complicated customer service problems.

Chapter 3: How does Akhil define the gap in AI adoption by businesses?

141.613 - 162.591 Akhil Verghese

So not your typical like, hey, where's my order kind of thing, but actually investigating audit logs, providing conclusions, spotting security leaks, things that it was really critical not to be wrong on. And obviously I was trying to adopt best practices from what I could find online. And I just found that they weren't working that well. And basically I identified that

0

162.571 - 185.444 Akhil Verghese

we almost need to rewrite the book on how we approach software engineering when it comes to building systems for these very non-deterministic things to function well in, while still preserving the elements that make them special, which is honestly the non-determinism and the fact that they're not predictable as part of, it's a feature, it's not a bug, but at the same time for enterprise systems, you need to build around that.

0

185.784 - 199.292 Akhil Verghese

And that's kind of what led to Krasmo. It really wasn't well planned or anything. It was just something that kind of came out of that other companies started reaching out and asking if I could help out. I got Google's permission to do that and just moonlighted for a while along with my co-founder.

0

199.633 - 205.328 Akhil Verghese

And then at some point it became clear that this was a viable business and we both left Google in June of last year.

0

206.09 - 224.59 Brian Thomas

That's amazing. Really appreciate that. And again, and I love the stories that start out here on the podcast. You found a gap, right, in the market. And you said, gosh, there is a need here. Let me see if I can take this a bit further. I just love the backstories on these. It's just amazing. So I appreciate that.

224.57 - 240.283 Brian Thomas

And Akhil, Crosmo's mission is to bring reliable enterprise grade generative AI to market. What gap do you see in how businesses were adopting AI that convinced you there was a company worth building here? And we just kind of talked on that a little bit.

240.382 - 263.301 Akhil Verghese

Yeah, so I'm probably at risk of reinforcing a lot of Indian stereotypes here, but most of my friends in school wanted to be engineers or doctors. And I feel like it was interesting because I felt like one of the very fundamental differences that played a role in weighing which choice they went with was their love of...

263.281 - 285.019 Akhil Verghese

being able to understand the system fully and being comfortable with ambiguity and uncertainty and the fact that answers are very rarely yes or no, but it could be this, could be that. And so I found that engineers in general are very uncomfortable with that. And it's sort of built in. It's one of the reasons they became engineers.

284.999 - 307.8 Akhil Verghese

And what I found is that when applying these systems that work really well in demos to enterprise environments, you really have to figure out ways to separate out the magic of LLMs into chunks that are predictable, reliable, and most importantly, testable.

Chapter 4: What challenges do enterprises face when deploying AI systems?

307.78 - 326.481 Akhil Verghese

so that you can bring in the level of oversight and everything else that you need to ensure that people actually feel comfortable deploying these systems. And so this is really the gap that I found is that engineers aren't really wired to think this way. And it kind of requires us to take a step back

0

326.461 - 345.885 Akhil Verghese

re-evaluate the sort of risks we're comfortable with and where we're comfortable with taking them and then identifying the areas we're not comfortable with risk and finding workarounds, whether that's human oversight or human in the loop to kind of ensure that those areas remain not just predictable, but also accountable.

0

345.906 - 366.495 Akhil Verghese

Because at the end of the day, you can never hold an LLM accountable for a mistake. And you can't punish an LLM. Right. And so there is no, there are certain elements that even if the LM did it perfectly, you need accountability there for legal liability reasons and things like that. And it's about breaking up that system in a way that all of this works well together.

0

366.876 - 385.55 Brian Thomas

Thank you. Really appreciate that. I know there's a lot that goes into it. Talk to hundreds of founders and CEOs, folks like you on the podcast the last two years, and it's Absolutely true. There's a lot that goes in to building an LLM, making sure the guardrails are there.

0

385.57 - 403.229 Brian Thomas

And of course, at the end of the day, as they always talk about this human in a loop, truly in your case, the human must be in a loop because the LLM is ultimately not responsible. So I appreciate that. And Akhil, you've argued that AI models have become a commodity and that architecture is the real advantage. Can you unpack that?

403.69 - 411.194 Brian Thomas

For a business leader, why does the system you build around the model matter more than the model itself? Okay, yeah, great question.

411.254 - 425.438 Akhil Verghese

So I think the best way to understand this is with an example, right? And I think the gap here, again, comes into this engineering mindset. If something works, it works. It's usually binary. And that's just not the case when it comes to LLMs. So let's take a really simple example.

425.478 - 441.501 Akhil Verghese

Imagine you're an e-commerce company and you want to have an agent that interacts with your customers and lets them do something really simple. So let's take... lesson change the date that the order is going to be delivered so i've got an order it's going to be delivered tomorrow i'm not available tomorrow i want you to deliver it the day after

Chapter 5: Why is human oversight crucial in AI architecture?

442.072 - 461.054 Akhil Verghese

Now, theoretically, right, and not even theoretically, I will put it in writing that modern LLMs can probably one-shot this problem. I just tell an LLM, hey, someone's going to ask you to do this. You check that they are editing in order that they have control over. You check that the day they're asking you to change to is the day that we deliver on.

0

461.094 - 483.28 Akhil Verghese

You check that maybe a few other things you put in the prompt. And if all of that is a green light, you just go and change it. That I am 100% certain that that would work at least 99% of the time. Now, there is not a single enterprise company that I know that would deploy that solution. And what is the gap, right? And so what is the solution that an enterprise company would deploy?

0

483.32 - 505.803 Akhil Verghese

Well, what would happen in real life is you would have the person ask the question, you would have a predictable non-AI based system that verifies who they are, that fetches their order numbers from a SQL query, which is completely structured and deterministic and gets, okay, this is the customer ID. This is a session key. These are the orders. So they have three orders.

0

506.264 - 521.318 Akhil Verghese

Which one are they talking about? And then you ask them which one they're talking about. They identify the order they're talking about either with a click or by saving it. And then you validate that and you say, okay, this is the order you want to change. Then you let the LLM do its thing. You let it figure out what it is that they want, which day they want it, all of that stuff.

0

521.819 - 545.62 Akhil Verghese

And then you have the LLM check with an API call. Is this modification possible? So you don't just give it right access to the database. There's a controlled API call that says, hey, you can change orders up to three days. The window is 9 a.m. to 3 p.m. All of this is fixed in the system, right? And then the LLM can run this call. The LLM then checks with the user.

Chapter 6: How can enterprises balance innovation and accountability in AI?

545.6 - 567.263 Akhil Verghese

hey, this is what I'm about to do. We're about to change order number 1234 to the 29th of May at 2 p.m. on Friday, 2 p.m. to 5 p.m. on Friday. Is this okay? And then when they press the thumbs up button, that's what triggers the update in the order database and then updates the entire system. Fundamentally, what I've just described is the same thing.

0

567.423 - 587.248 Akhil Verghese

And if you can one-shot this problem with an LLM for sure, but you've got to be so worried about prompt injection attacks. You've got to be worried about the cases where it gets it wrong. You've got to be worried about the cases where someone tries to manipulate it. So the gap here is not that isn't LLM intelligent enough to do the task that we're talking about.

0

587.288 - 603.547 Akhil Verghese

It's the architecture around it that actually makes it something that an enterprise will deploy. And the thing to note here is that It is a binary system. A system like this is either deployable or it's not. It's either useful or it's completely useless.

0

603.607 - 621.625 Akhil Verghese

It can be like 99% of the time and be completely useless if there's no accountability, if there's no systems to check that it does only what you plan on it doing. And I think that kind of example sort of illustrates the difference between the architecture gap and just one-shotting things with an LLM.

0

621.605 - 641.385 Brian Thomas

I really appreciate that. And you really broke that down for us. I do like that. Again, if you look back at this, you talked about the one shot and probably get 99% of it right. But at the end of the day, you talked about there's obviously there's a security piece of this, right? And you don't just want to give a full autonomy to the LLM.

641.365 - 659.568 Brian Thomas

But having that human in the loop, whether that's the customer or a human that works at the organization in the service area, whatever that is, I think it's important. It's almost like having nowadays it's built into our security, two-factor authentication, right? So same thing with this. There's got to be some sort of check and balances in place.

Chapter 7: What role do guardrails play in AI deployment?

659.608 - 673.331 Brian Thomas

I really like how you broke that apart. So I appreciate that. And then Akhil, last question of the day, as we look ahead to the future, you said you believe AI could free people from the modern 40 day work week and give us more time for self-fulfillment and creativity.

0

673.471 - 682.847 Brian Thomas

How do you see enterprise AI evolving over the next few years and what has to go right for that more optimistic future to materialize?

0

683.198 - 701.022 Akhil Verghese

Yeah. So I think it was, this was part of an interview when I talked about the optimistic future versus the pessimistic future. And this is definitely the optimistic future. I, I do believe that that's possible for sure. Right. I was, there was someone actually in London from the capital group that had kind of brought me in and was sort of getting my take on.

0

701.002 - 725.592 Akhil Verghese

You know, the real world impact on enterprise that AI is having today. And their thesis on investment and stuff like that was based on this very large picture view of the global economy, right? So if the global economy is $120 trillion, tech is sort of defined in a million different ways. But even if you take the broadest definition of tech, tech makes up about $16 trillion of that.

0

725.572 - 747.469 Akhil Verghese

Now about half of that economy, 120 trillion is the labor economy, right? Your salaries and things like that. So about 55 to 60 trillion is just salaries and things like that. Now, when you look at the AI evaluations as they are today and the projections that people are making, They are not restricting themselves to AI gobbling up a good part of that tech economy.

747.91 - 767.442 Akhil Verghese

They are essentially looking at AI gobbling up the 60 trillion part of the economy, right? Or some percentage of that, because there's no way these evaluations make sense without that. So there is no doubt in my mind that that is the goal, that some percent of that labor force economy is the goal of AI companies to gobble up.

768.907 - 785.027 Akhil Verghese

Now the question becomes, and this is not a question that I'm qualified to answer, it definitely requires an economist, is like how much of that can you gobble up before the harmony and the balance of the system as a whole kind of falls through, right? And what is the ideal version of it?

785.147 - 806.992 Akhil Verghese

So the utopian version of it is anyone who doesn't want to work doesn't have to work because we've got UPI and their lives are... comfortable, fulfilled. They find fulfillment in their hobbies and art and family and relationships and things like that. And then the people that do want to work, no one's working the kind of hours that we're working now. There's not this crazy burnout.

808.354 - 814.741 Akhil Verghese

Humans are still required for the more creative tasks, the more the tasks where we require accountability, like I mentioned.

Chapter 8: How does AI impact the future of work and the labor market?

815.061 - 823.23 Akhil Verghese

And the truth is that I learned as well, they're becoming incredibly smart. I think, I'm not sure who coined this term. I heard it from Andre Karpathy, but

0

823.21 - 851.935 Akhil Verghese

the idea of a jagged intelligence curve so lms are kind of progressing along a very jagged curve there are some areas where they're just brilliant and then there are some areas where they're shockingly bad right and so humans will always be needed to sort of pick up the slack and fill in the gaps and the question becomes if that requirement becomes smaller and smaller is that achieved by laying off everyone or is that achieved by everyone working less and obviously i think the more optimistic solution the more egalitarian solution and

0

851.915 - 872.256 Akhil Verghese

Probably the better solution for humanity as a whole is that everyone works a bit less. So yeah, that's kind of the ideal future that I see. I think there's systems like that are never built by the companies deploying the technology. They have to be built by the people and by governments. I haven't seen a lot of proof that that's where we're headed.

0

872.536 - 891.709 Akhil Verghese

But at the same time, I also do feel like society does have checks and balances for this thing. Like there is a certain unemployment level that society tolerates. And this is just borne out by history. Like, I don't know what the unemployment level was before the French Revolution, but you know, it was, it can't have been more than 20%, I think. So again, not a historian, but...

0

891.689 - 906.658 Akhil Verghese

I think there is some balance where society as a whole will push back. I think we already are seeing that pushback on AI. And so, yeah, I think we're headed for very interesting times for sure. And whether that ends up being a good thing or a bad thing, I think is very much in the balance.

906.718 - 929.654 Brian Thomas

But yeah, I'm very hopeful for the optimistic future, but let's see. Yeah, like you, I'm very optimistic. We just need to understand that guardrails need to be in place all around. And there's some there's people I know that literally work for maybe minimum dollars per hour under the federal rules and guidelines, labor laws, and they're fulfilled. They have purpose in their life.

929.754 - 947.101 Brian Thomas

And so there's those situations, too, where, well, I could replace that person. But if that person gets fulfilled doing that work. and it makes sense for the company, for example, whatever that salary they make, then we need to ensure that stuff is in place as well. But I appreciate the insights, really do.

947.141 - 958.399 Brian Thomas

And Akio, I really appreciate having you on today and I look forward to speaking with you real soon. Thank you so much for having me, Brian. It was great answering your questions. They're really great questions. Bye for now.

Comments

There are no comments yet.

Please log in to write the first comment.