Sebastian Raschka
speaker
1,024 appearances
1 recordings
1 series
first heard Feb 2026
last heard 1 Feb
Sebastian Raschka’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Feb 2026 with 1.
Appearances
I think, to be honest with you, continual learning, the updating of weights, we already have that in different flavors.
I mean, if you think about how, so I think the distinction here is, do you do that on a personalized custom model for each person or do you on a global model scale?
And I think we have that already with
going from GPT-5 to 5.1 and 5.2.
It's maybe not immediate, but it is like a curated update, a quick curated update where there was feedback by the things it couldn't do, feedback by the community.
They updated the weights, next model and so forth.
So it is, I mean, kind of like a flavor of that.
Other even finer grained example is like RLVR.
You run it, it updates.
The problem is you can't just do that
for each person because it would be too expensive to update the weights for each person.
And I think that's the problem.
So unless you get, I mean, even at OpenAI scale, building data centers, it would be too expensive, I think.
That is only feasible once you have something on the device where the cost is on the consumer, like what Apple tried to do with the Apple Foundation models, putting them on the phone, and then they learn from the experience.
So right now it's mostly like context, basically stuffing things into the context and then just recalling that.
But again, I think, well, it's expensive because you have to... I mean, you can cash it, but still you spend tokens on that.
And the second one is you can only do so much.
I think it's more like a preference or a style.
I mean, a lot of people do that when they solve math problems.
You say, it's basically you can...
Showing 701–720 of 1,024 · page 36 of 52
← Previous
Next →