Sebastian Raschka
speaker
1,024 appearances
1 recordings
1 series
first heard Feb 2026
last heard 1 Feb
Sebastian Raschka’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Feb 2026 with 1.
Appearances
You have to now think about sharding your parameters across multiple GPUs.
Even for the KV cache, there are multiple ways you can implement it.
One is just to understand how it works, just to grow the cache.
It's like a cache you grow step by step by, let's say, concatenating lists and growing it.
But then that wouldn't be optimal in GPUs.
You wouldn't do that.
You would pre-allocate a tensor and then fill it in.
But that adds, again, another 20, 30 lines of code.
And for each thing,
You add so much code.
And I think the trick with the book is basically to understand how the LLM works.
It's not going to be your production-level LLM.
But once you have that, you can understand the production-level LLM.
Yes.
Most of them, I have some bonus materials on some MOE models.
I think one or two of them, they may require multiple GPUs, but...
The goal is to have it on one GPU.
And the beautiful thing is also you can self-verify.
It's almost like RLVR.
When you code these from scratch, you can take an existing model from the Hugging Face transformer library.
Showing 501–520 of 1,024 · page 26 of 52
← Previous
Next →