Companies are spending billions on GPUs, data centers, foundation models, and AI infrastructure. But what happens when the network connecting all of it cannot keep up? In this episode of Tech Talks Daily, I welcome back Avi Freedman, co-founder and CEO of Kentik, five years after our previous conversation. Avi has been operating large-scale networks since the 1990s, including more than a decade at Akamai, and brings a rare combination of founder experience and hands-on knowledge of how the internet actually works. We discuss why network performance is becoming an important factor in determining the return companies receive from their AI investments. If organizations cannot move data efficiently to models or deliver inference reliably to users and applications, expensive compute infrastructure can sit waiting while performance suffers and costs increase. Avi explains what technology leaders should measure to determine whether their network is helping or hindering AI workloads. This includes establishing performance baselines, synthetic testing across cloud and AI providers, understanding dependencies across the digital supply chain, and using observability to identify what changed when performance deteriorates. The conversation also examines network intelligence and why collecting telemetry alone is not enough. Organizations need to connect network data with the applications and users affected, understand historical behavior, determine which problems matter, and give network teams enough context to act quickly. Agentic AI introduces another opportunity. Avi explains how AI agents can increasingly perform the work of experienced network engineers by monitoring baselines, investigating alerts, troubleshooting problems, and recommending actions. But fully autonomous networks remain some distance away. Most enterprises currently want humans deciding whether significant production changes should be made. That leads us into governance. As businesses give AI systems access to increasingly important infrastructure, credentials, permissions, guardrails, and oversight become major considerations. Avi warns about ungoverned AI systems gaining proxy access to corporate infrastructure and explains why companies need clear boundaries around what agents can see and do. We also revisit a lesson from decades of internet infrastructure: individual components will fail. Rather than attempting to create networks that never fail, businesses should design for resilience through redundancy, over-provisioning, monitoring, and architectures capable of continuing when something inevitably breaks. For founders, CIOs, CTOs, network engineers, and infrastructure leaders building around AI, Avi offers practical advice on observability, network resilience, autonomous operations, AI infrastructure, and knowing when networking expertise should be developed internally or brought in from elsewhere. And we finish somewhere unexpected: how CEOs can use AI to make better decisions by explicitly asking it to disagree with them. Avi explains why turning AI from a sycophantic assistant into an argumentative colleague can expose weaknesses in an idea, improve communication, and help leaders test their thinking. AI may be transforming software, compute, and business operations, but none of it works without connectivity. As AI becomes part of the operational backbone of the enterprise, understanding the network underneath it becomes increasingly difficult to ignore.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Transcript

Related