Jon Krohn
speaker
6,465 appearances
25 recordings
1 series
first heard Jul 2026
last heard 4d ago
Jon Krohn’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 25 in all, peaking in Jul 2026 with 9.
Appearances
Tyler was talking a few minutes ago about kind of this explore tier where you've got Dell Pro Max with GB10 or Dell Pro Precision T2 tower.
podcast-host
You've got, and so that handles up to like eight agents running concurrently.
podcast-host
You've got this orchestrate tier where you've got 40 agents.
podcast-host
That's more like a T4 tower supporting 120 to half a trillion parameter models.
podcast-host
And then obviously you've got the big heavy hitters, your GB300s, your Dell Pro Precision T6 tower where you're talking about trillion parameter models.
podcast-host
150 agents running.
podcast-host
And it sounds, or from research that we did prior to recording this episode, Signal 65, we've mentioned them already earlier, they're a third party that does research for Dell.
podcast-host
They provided some pretty staggering stats where if you talk about common kind of workload types that you would be doing in this agentic era that we now find ourselves in,
podcast-host
someone who's like a knowledge worker doing low complexity tasks like email writing, text summarization, that kind of thing.
podcast-host
You can see by having a desk side solution like Dell offers, as opposed to paying per token with a proprietary API, you'd be seeing savings of like 28% to 71%, that kind of thing.
podcast-host
a sales agent.
podcast-host
So we're talking like, you know, increasing complexity here where you have, you know, a mix of that kind of email writing that the knowledge worker was doing, but also maybe research tasks happening, you know, going out and finding out information about a prospective client or lead gathering sales contacts, that kind of thing.
podcast-host
So if you're talking tens of millions of tokens per agent per day, you could be in that kind of medium complexity scenario, saving 76% to 91% versus cloud solutions.
podcast-host
And then for a lot of our listeners doing software development, using agents to be increasingly, you know, looking more like that METR chart, using agents for handling tasks that take hours or days for a human to do.
podcast-host
We're now talking about like tens of millions of tokens per agent per day being consumed, many potentially dozens of agents, sub-agents running.
podcast-host
And
podcast-host
And it's that as you move more, I mean, you're seeing savings even with a low complexity like knowledge work, kind of agentic work.
podcast-host
But once we're getting to this high complexity, co-generation, code review, bug troubleshooting, testing, it starts to become a no-brainer where you're seeing like 90% savings relative to using a cloud solution.
podcast-host
All right, so all of that sounds great.
podcast-host
Between all of us, we've given now a good run-through of the tokenomics problem, the potential solution, the compelling solution in a lot of cases for having a desk-side or on-prem solution to be saving money and getting the same kinds of results faster in a lot of cases.
podcast-host
Showing 221–240 of 6,465 · page 12 of 324
← Previous
Next →