Distilling Step-by-Step: Outperforming LLMs with Less Data

episode

Build Wiz AI Show not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

Related

recent transcribed audio

#502 – Psychiatry, Insane Asylums, Mental Illness, ECT, Lobotomies, Freud & Jung 3h 43m · 17 Sep 2026 · Lex Fridman Podcast

Your partner wants profit. You want freedom. Now what? 22 min · 16 Sep 2026 · The Optometry Success Podcast

Board of County Supervisors Meeting - Work Session - Sep 15, 2026 3h 17m · 15 Sep 2026 · Prince William County Board of Supervisors

Finance and Budget Committee - Sep 15, 2026 1h 43m · 15 Sep 2026 · Prince William County Finance and Budget Committee

Sept. 15, 2026 Board of Supervisors Meeting 8h 46m · 15 Sep 2026 · Fairfax County Board of Supervisors

The Art of True Happiness | Dr. Arthur Brooks 2h 49m · 14 Sep 2026 · Huberman Lab

Report any issue

Source

Recorded08 Sep 2025

Publisheranchor.fm ↗

Handlerec:12512894

Show notes

Join us as we explore LLM knowledge distillation, a groundbreaking technique that compresses powerful language models into efficient, task-specific versions for practical deployment. This episode delves into methods like TinyLLM and Distilling Step-by-Step, revealing how they transfer complex reasoning capabilities to smaller models, often outperforming their larger counterparts. We'll discuss the benefits, challenges, and compare distillation with other LLM adaptation strategies like fine-tuning and prompt engineering.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in