The AI Concepts Podcast
Episodes
Module 4: Quantization - Shrinking Models Without Breaking Them
25 Feb 2026
Contributed by Lukas
This episode tackles the lever that turns powerful LLMs into something you can actually run: quantization. We explore what it means to store model wei...
Module 4: Optimization - The GPU Memory Bottleneck
24 Feb 2026
Contributed by Lukas
This episode addresses the real bottleneck after you build an LLM: fitting it into hardware that can actually run it. We explore why GPU memory is the...
Module 3: Reinforcement Learning from Human Feedback
20 Feb 2026
Contributed by Lukas
This episode addresses how Reinforcement Learning from Human Feedback (RLHF) adds the final layer of alignment after supervised fine-tuning, shifting ...
Module 3: Supervised Fine Tuning
20 Feb 2026
Contributed by Lukas
This episode addresses how we turn a raw base model into something that behaves like a real assistant using Supervised Fine-Tuning (SFT). We explore i...
Module 3: Context Windows & Attention Complexity
26 Jan 2026
Contributed by Lukas
This episode addresses the physical and mathematical limits of a model’s "short-term memory." We explore the context window and the engineering trad...
Module 3: The Lifecycle of an LLM : Pre-Training
25 Jan 2026
Contributed by Lukas
This episode explores the foundational stage of creating an LLM known as the pre-training phase. We break down the Trillion Token Diet by explaining h...
Module 2: The MLP Layer - Where Transformers Store Knowledge
06 Jan 2026
Contributed by Lukas
Shay explains where a transformer actually stores knowledge: not in attention, but in the MLP (feed-forward) layer. The episode frames the transformer...
Module 2: The Encoder (BERT) vs. The Decoder (GPT)
05 Jan 2026
Contributed by Lukas
Shay breaks down the encoder vs decoder split in transformers: encoders (BERT) read the full text with bidirectional attention to understand meaning, ...
Module 2: Multi Head Attention & Positional Encodings
05 Jan 2026
Contributed by Lukas
Shay explains multi-head attention and positional encodings: how transformers run multiple parallel attention 'heads' that specialize, why we concaten...
Module 2: Inside the Transformer -The Math That Makes Attention Work
03 Jan 2026
Contributed by Lukas
In this episode, Shay walks through the transformer's attention mechanism in plain terms: how token embeddings are projected into queries, keys, and v...
Module 2: Attention Is All You Need (The Concept)
03 Jan 2026
Contributed by Lukas
Shay breaks down the 2017 paper "Attention Is All You Need" and introduces the transformer: a non-recurrent architecture that uses self-attention to p...
Module 2: The Transformer Architecture: History - The Bottleneck That Broke Language Models
03 Jan 2026
Contributed by Lukas
Shay breaks down why recurrent neural networks (RNNs) struggled with long-range dependencies in language: fixed-size hidden states and the vanishing g...
Module 1: Tokens - How Models Really Read
13 Dec 2025
Contributed by Lukas
This episode dives into the hidden layer where language stops being words and becomes numbers. We explore what tokens actually are, how tokenization b...
Module 1: The Autoregressive Assumption | How Language Emerges in AI
13 Dec 2025
Contributed by Lukas
This episode explores the hidden engine behind how language models move from knowing to creating. It reveals why generation happens step by step, why ...
Module 1: The Latent Space & Manifolds | How Models Encode Meaning
13 Dec 2025
Contributed by Lukas
This episode is about the hidden space where generative models organize meaning. We move from raw data into a compressed representation that captures ...
Module 1 - The Generative Turn (Discriminative vs. Generative)
13 Dec 2025
Contributed by Lukas
Welcome to Episode One of The Generative Shift. This episode introduces the core change behind modern AI, the move from discriminative models that dra...
Intro to The Generative AI Series
13 Dec 2025
Contributed by Lukas
Hello everyone, and welcome to The Generative AI Series. I’m Shay, and this introductory episode is about why this series exists and who it is for. ...
Deep Learning Series: Autoencoders
17 Jul 2025
Contributed by Lukas
Welcome to the final episode of our Deep Learning series on the AI Concepts Podcast. In this episode, host Shay takes you on a journey through the wor...
Deep Learning Series: Transformers
17 Jul 2025
Contributed by Lukas
Welcome to the AI Concepts Podcast, where we explore AI, one concept at a time. In this episode, host Shay delves into the transformative world of tra...
Deep Learning Series: Attention Mechanism
17 Jul 2025
Contributed by Lukas
In this episode of the AI Concepts Podcast, host Shay delves into the transformation of deep learning architectures, highlighting the limitations of R...
Deep Learning Series: Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU)
13 Apr 2025
Contributed by Lukas
Welcome to another episode of the AI Concepts Podcast, where we simplify complex AI topics into digestible explanations. This episode continues our De...
Deep Learning Series: Recurrent Neural Network
13 Apr 2025
Contributed by Lukas
Welcome to the AI Concepts Podcast! In this episode, we dive into the fascinating world of Recurrent Neural Networks (RNNs) and how they revolutionize...
Deep Learning Series: Convolutional Neural Network
13 Apr 2025
Contributed by Lukas
Welcome to the AI Concepts Podcast! In this deep dive into Convolutional Neural Networks (CNNs), we unravel their unique ability to process and interp...
Deep Learning Series: What is Batch Normalization?
13 Apr 2025
Contributed by Lukas
In this episode of the AI Concepts Podcast, host Shay delves into the complexities of deep learning, focusing on the challenges of training deep neura...
Deep Learning Series: Advanced Optimizers Part II - RMSprop and ADAM
11 Apr 2025
Contributed by Lukas
In this enlightening episode of the AI Concepts Podcast, join host Shay as we dive deep into the world of deep learning optimizers. Discover how RMSPR...
Deep Learning Series: Advanced Optimizers - SGD and SGDM
11 Apr 2025
Contributed by Lukas
Welcome to the AI Concepts Podcast, where host Shay unravels the intricate world of AI through relatable examples and easy-to-understand analogies. In...
Deep Learning Series: What is Gradient Descent?
10 Apr 2025
Contributed by Lukas
In this episode of the AI Concepts Podcast, we dive into the fascinating world of gradient descent. Building on the foundation laid in our discussion ...
Deep Learning Series: What is Backpropagation?
09 Apr 2025
Contributed by Lukas
Welcome to the latest episode of the AI Concepts Podcast, hosted by Shay, where we continue our exploration of deep learning. In this installment, we ...
Deep Learning Series: What is a Feedforward Neural Network?
08 Apr 2025
Contributed by Lukas
Welcome to this episode of the AI Concepts Podcast. Join host Shay as we delve into the fundamental architecture behind modern deep learning - the fee...
Deep Learning Series: What is a Neural Network?
07 Apr 2025
Contributed by Lukas
Welcome to this episode of the AI Concepts Podcast's Deep Learning series, where we delve into the fascinating world of neural networks. Neural networ...
Deep Learning Series : What is Deep Learning?
07 Apr 2025
Contributed by Lukas
Welcome to the AI Concepts Podcast, your go-to podcast for exploring AI concepts with clarity and simplicity. Join your host, Shay, as we embark on a ...
Markov Decision Processes (MDPs): The Framework Behind Smart Decision-Making in AI
30 Jan 2025
Contributed by Lukas
Welcome to the AI Concepts Podcast, where host Shea simplifies complex AI ideas. In this episode, we delve into Markov Decision Processes (MDPs), a pi...
Gradient Descent Explained: How ML Models Learn to Optimize
29 Jan 2025
Contributed by Lukas
In this episode of the AI Concepts Podcast, host Shea breaks down the concept of gradient descent, a crucial mechanism in machine learning that helps ...
Principal Component Analysis: What It Is and How It Works
28 Jan 2025
Contributed by Lukas
Welcome to another informative episode of the AI Concepts Podcast, hosted by Shea. Today, we delve into the intricate world of Principal Component Ana...
What is K-Nearest Neighbors and How Does It Work?
27 Jan 2025
Contributed by Lukas
Welcome to the AI Concepts Podcast, where we uncover AI mysteries one piece at a time. In this episode, join your host Shea as we dive into the world ...
What Is K-Means Clustering and How Does It Work?
20 Dec 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast, where we unravel the complexities of AI, one concept at a time. In this episode, we delve into the world of unsupe...
What Is Support Vector Machine and How Does It Work?
20 Dec 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast, hosted by Shay, where we demystify complex AI topics, one concept at a time. In this episode, we delve into Suppor...
What Are Ensemble Methods and How They Work ?
20 Dec 2024
Contributed by Lukas
In this episode of the AI Concepts Podcast, host Shay delves into the world of ensemble methods, specifically focusing on boosting. Discover how boost...
What Is Random Forest and How Does it Work?
20 Dec 2024
Contributed by Lukas
Welcome to the latest episode of the AI Concepts Podcast, where we delve into the fascinating world of artificial intelligence. Join our host, Shay, a...
What Is a Decision Tree and How Does It Work?
20 Dec 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast! In this episode, Shay delves into the fascinating world of decision trees, a fundamental and uncomplicated tool in...
What is Logistic Regression and How Does It Work?
15 Dec 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast, where your host Shay delves into the intricacies of artificial intelligence, one concept at a time. This episode f...
What Is Linear Regression and How Does It Work?
15 Dec 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast, where AI is explored one concept at a time. Your host, Shay, simplifies AI concepts using relatable examples and a...
Machine Learning Series: The Machine Learning Workflow
10 Dec 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast! In this episode, host Shay launches a new series dedicated to machine learning, guiding you through the essential ...
AI Essentials Series - Precision, Recall, F1 Score, ROC and AUC
21 Nov 2024
Contributed by Lukas
In episode 11 of the AI Concepts Podcast, host Shay takes listeners on a journey beyond traditional accuracy metrics to explore the deeper nuances of ...
AI Essentials Series - Evaluating AI Models: The Accuracy Trap
21 Nov 2024
Contributed by Lukas
Welcome to episode 10 of the AI Concepts Podcast, where host Shea delves into the intricacies of model evaluation metrics, starting with accuracy. In ...
AI Essentials Series - How do AI Models Learn?
06 Nov 2024
Contributed by Lukas
Welcome to Episode 9 of the AI Concepts Podcast, where we delve into the essential components of machine learning: training data, validation data, and...
AI Essentials Series - Classification Vs Regression in Machine Learning
06 Nov 2024
Contributed by Lukas
Welcome to Episode 8 of the AI Concepts Podcast, where we delve into the fascinating world of machine learning. Join your host, Shea, as we unravel th...
AI Essentials Series - What is Reinforcement Learning?
05 Nov 2024
Contributed by Lukas
Welcome to Episode 7 of the AI Concepts Podcast, where we delve into the fascinating world of reinforcement learning. Unlike supervised and unsupervis...
AI Essentials Series - What is Unsupervised Learning?
04 Nov 2024
Contributed by Lukas
Welcome to episode 6 of the AI Concepts Podcast, where host Shea takes you on an insightful journey into the world of unsupervised learning. Discover ...
AI Essentials Series - What is Supervised Learning?
03 Nov 2024
Contributed by Lukas
Welcome to Episode 5 of the AI Concepts Podcast, where host Shea takes you on an enlightening journey into the world of supervised learning, a corners...
AI Essentials Series - Understanding Data, Algorithms, and Compute
02 Nov 2024
Contributed by Lukas
Welcome to Episode 4 of the AI Concepts Podcast! Join host Shea as we delve into the fundamental components that power artificial intelligence: data, ...
AI Essentials Series - AI vs. Machine Learning vs. Deep Learning: Key Differences Explained
01 Nov 2024
Contributed by Lukas
Welcome to episode three of the AI Concepts Podcast! In this episode, host Shea delves into the fascinating world of artificial intelligence, machine ...
AI Essentials Series - The Evolution of AI
31 Oct 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast, where we delve into artificial intelligence, one concept at a time. In this episode, host Shea takes you on a thri...
AI Essentials Series - What is AI?
30 Oct 2024
Contributed by Lukas
Welcome to the very first episode of the AI Concepts Podcast! Join your host, Shay, as we embark on an exciting journey to explore the fascinating wor...
Welcome: Who Should Listen to This Podcast
29 Oct 2024
Contributed by Lukas
Welcome to the AI Concepts Podcast, your quick guide to understanding the world of Artificial Intelligence. Whether you're curious about algorithms, g...