Stable Diffusion and LLMs at the Edge with Jilei Hou - #633

episode

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

Related

recent transcribed audio

A.I. Safety Goes Mainstream + a ‘Hard Fork’ Exit AMA 1h 25m · 18 Sep 2026 · Hard Fork

AWP: Beyond the Exam Room: Purpose, Myopia, and Population Health 54 min · 17 Sep 2026 · EyeCode Media

Planning Commission Meeting - Sep 17, 2026 1h 11m · 17 Sep 2026 · Leesburg Planning Commission

Heritage Commission - Sep 14, 2026 1h 57m · 17 Sep 2026 · Loudoun County Board Committees and Advisory Boards

Historic District Review Committee - Sep 14, 2026 1h 36m · 17 Sep 2026 · Loudoun County Board Committees and Advisory Boards

Planning Commission Work Session - Sep 17, 2026 4h 39m · 17 Sep 2026 · Loudoun County Planning Commission

Report any issue

Source

Recorded12 Jun 2023

Publisherfeeds.megaphone.fm ↗

Handlerec:12495902

Show notes

Today we’re joined by Jilei Hou, a VP of Engineering at Qualcomm Technologies. In our conversation with Jilei, we focus on the emergence of generative AI, and how they've worked towards providing these models for use on edge devices. We explore how the distribution of models on devices can help amortize large models' costs while improving reliability and performance and the challenges of running machine learning workloads on devices, including model size and inference latency. Finally, Jilei we explore how these emerging technologies fit into the existing AI Model Efficiency Toolkit (AIMET) framework. The complete show notes for this episode can be found at twimlai.com/go/633

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in