Transformers: The Discovery That Sparked the AI Revolution

episode

Y Combinator Startup Podcast not yet transcribed

▲ 0

Transcript

This episode hasn't been transcribed yet Upvotes decide what gets transcribed next — 0 so far. Sign in to upvote

More from Y Combinator Startup Podcast

Max Junestrand: You Need The Willingness To Learn Faster Than Anyone Else 59 min · 29 Aug 2026

Susan Kare: Designing Icons & Graphics For the Original Mac 51 min · 28 Aug 2026

Chelsea Finn: This is the State of the Art in Robotics 58 min · 13 Aug 2026

Peter Steinberger: "Fun Is Velocity" 41 min · 11 Aug 2026

Max Hodak: How Startups Build Speed 57 min · 10 Aug 2026

How To Design In The Agent Era 56 min · 07 Aug 2026

All episodes from Y Combinator Startup Podcast →

Report any issue

Source

Recorded23 Oct 2025

Publisheranchor.fm ↗

Handlerec:13024439

Show notes

Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.

Ask this episode

“What did the council decide on item 42?” — answered with the speaker and the moment.

Sign in