Ep 7: Co-Creator of Databricks Dolly Mike Conover on Open-Source LLMs

Audio

Description

Patrick and Jacob sit down with Mike Conover, Staff Software Engineer at Databricks and Co-Creator of Databricks Dolly, the world’s first truly open instruction-tuned LLM, to discuss the magic behind Dolly, Alpaca and other instruction-tuned LLMs, the unreasonable effectiveness of fine-tuning, how they got all Databricks employees to help them curate the Dolly dataset (hint: google forms), and more. (0:00) - Intro(5:54) - The birth of Dolly(12:03) - Data curation at Databricks(15:34) - Advice for building LLMs(24:10) - The future of instruction-tuning datasets(30:43) - UI innovation(38:16) - The future of machine learning infrastructure(42:05) - How SkipFlag would be different with the tools we have today(47:01) - What Mike has learned since Dolly With your co-hosts:@jasoncwarner- Former CTO GitHub, VP Eng Heroku & Canonical@ericabrescia- Former COO Github, Founder Bitnami (acq’d by VMWare)@patrickachase- Partner at Redpoint, Former ML Engineer LinkedIn@jacobeffron- Partner at Redpoint, Former PM Flatiron Health

Transcription

This episode hasn't been transcribed yet

Help us prioritize this episode for transcription by upvoting it.

0 upvotes

🗳️ Sign in to Upvote

Popular episodes get transcribed faster

Unsupervised Learning with Jacob Effron

This episode hasn't been transcribed yet

Other recent transcribed episodes

3ª PARTE | 17 DIC 2025 | EL PARTIDAZO DE COPE

13:00H | 21 DIC 2025 | Fin de Semana

12:00H | 21 DIC 2025 | Fin de Semana

10:00H | 21 DIC 2025 | Fin de Semana

13:00H | 20 DIC 2025 | Fin de Semana

12:00H | 20 DIC 2025 | Fin de Semana

Sign in to Audioscrape

Share this moment