In this episode of The Q&AI Podcast, Bob chats with Ram Velaga of Broadcom about their pivotal role in the AI world. They explore the rise of custom AI accelerators, the GenAI boom, and how Broadcom enables massive AI clusters. They also discuss AI's practical applications within Broadcom, build vs buy strategies, the future of AI, and the networking revolution it's driving, both in data centers and at the edge.-----Key points covered:Broadcom's role in AI: How Broadcom provides essential IP and networking solutions for AI development, despite not producing GPUs directlyThe rise of custom accelerators: The trend of large cloud providers developing their own in-house accelerators for AI workloads Generative AI and LLMs: The current focus on building large language models and their potential impact on various industries AI within Broadcom: Exploring internal use cases for AI, including customer support, software development, and silicon designBuild vs buy for AI solutions: Strategies for leveraging existing LLMs while protecting proprietary data The future of AI: Ram's perspective on the timeline for achieving more advanced AI capabilities and the massive investments being made A new software paradigm: Discussion of potential shifts in software development practices due to AI Networking for AI: The critical role of high-speed, scalable networks in supporting distributed AI computing AI at the edge: Exploring use cases for AI processing at the network edge, including set-top boxes, Wi-Fi, and computer vision The multi-billion-dollar question: The potential for AI to generate significant revenue and the need for diverse applications-----Where to find Ram Velaga?LinkedIn - https://www.linkedin.com/in/ram-v-124b79/ Where to find Bob Friday?LinkedIn - https://www.linkedin.com/in/bobfriday/-----To stay updated on the latest episodes of The Q&AI Podcast and other exciting content, subscribe to our podcast on the following channels: Apple Podcasts - https://podcasts.apple.com/us/podcast/the-q-ai-podcast/id1774055892 Spotify - https://open.spotify.com/show/0S1A318OkkstWZROYOn3dU?si=5d2347e0696640c2 YouTube - https://www.youtube.com/playlist?list=PLGvolzhkU_gTogP5IBMfwZ7glLp_Tqp-C We hope you enjoyed this episode!

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Transcript

Related