Sebastian Raschka
speaker
1,024 appearances
1 recordings
1 series
first heard Feb 2026
last heard 1 Feb
Sebastian Raschka’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Feb 2026 with 1.
Appearances
Maybe OpenAI will be then pivoted
focus on some other sub topic like the they have too many users to go away and foreseeable future i think
not an open weight one.
It's interesting.
I think also just to recap a bit, I think, I mean, Lama was the, I would say, pioneering open weight model and then Lama 1, 2, 3, a lot of love.
But I think then, I think what happened, just hypothesizing or speculating, I think the leaders at Meta, like the upper executives, they
I think they got really excited about Lama because they saw how popular it was in the community.
And then I think the problem was trying to, let's say, monetize the open... Not monetize the open source, but like kind of use the open source to make a bigger splash in a sense, like to kind of force it almost.
It felt forced, like developing these very big Lama 4 models to...
have like the best like to be on the top of the benchmarks but i don't think the goal of llama models is to be on top of the benchmarks beating let's say chachapiti or other models i think the goal was to have a model that people can use trust modify understand that includes having smaller models they don't have to be the best models and what happened was just these models were of course like the benchmarks suggested they were better than they were by because i think they had like
specific models trained on preferences that they perform well on the benchmarks it's kind of like this overfitting thing to kind of force it to be the best but then at the same time they didn't do the small models that people could use and i think that no one could run these big models then and then it was kind of like a weird thing and i think it's just because people got too excited about headlines pushing the frontier
But I think also the problem, not the problem, but I think, well, we may have been a bit also too harsh, I think, and that caused some of that because I think, I mean, we as open source developers or the open source community, because I think even though the model was maybe not what everyone hoped for, it got a lot of backlash.
And I think that was a bit unfortunate because I can see that as a company, now they were hoping for positive headlines and
uh instead of just getting no headlines or not these positive headlines in turn they got negative headlines and then all it kind of reflected bad on the company and i think that is also something like where you it's maybe a spite reaction almost like okay we have not we we try to do something nice we try to give give you something cool like an open source model and now you are like you know
Also for education and talent for these companies, it's, I think, very important because otherwise, you know, if they're only closed models, how do you get the next generation of people contributing at some point?
Because otherwise you will at some point...
only be able to learn after you joined a company.
But then at that point, like how do you hire talented people?
How do you identify talented people?
And I think open source is, that's even for a lot of things, but also even just for educating the population and training the next generation of researchers.
Showing 901–920 of 1,024 · page 46 of 52
← Previous
Next →