Dean W. Ball

speaker
545 appearances 1 recordings 1 series first heard Nov 2024 last heard Nov 2024

Dean W. Ball’s voice in public audio — every appearance, attributed to the second.

Trend

recordings per month · last 12 months
No recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.

Appearances

newest first · ▶ plays the moment
Cause to me it's like
That's retaining the optionality to some extent.
And I do understand that there might be scenarios where open source creates additional kinds of risks.
But I think those risks are exceptionally worth it if you think about the scenarios Daniel is describing.
even if I disagree with some of the specifics, I like directionally agree entirely that this is the big challenge and like how you deal with the economics of all of it.
I mean, one thing I'm not a hundred percent sure about is like Andre Karpathy talks about, can you distill these models to sub current models to sub one billion parameter?
just like kind of the raw intelligence ability and then get the world knowledge like some other way, like some vector database or something like that.
And or just like searching the web where it the world knowledge from whence it came uh and make that thing like extremely fast and do, you know, sort of like r RL based tuning on that.
And can you instantiate like a million of those
How does that compare to the bigger thing, which is maybe like a thousand a thousand GPT fives versus ten million
little sub one billion parameter things.
I don't know.
Like I I think that's all gonna be interesting.
But I don't rule out scenarios like that where it actually like small becomes the new cool thing.
And actually like there's some degree of competit I mean, this is kinda already happening.
Like there's a little bit of competition of who can actually make the smallest model, the best smallest, small model.
That might get more that might become like more significant vector of competition in the field.
I don't have a strong opinion on which direction it goes or
And the answer is probably both, as with most things, but I don't know which will be more salient.
But that could solve some of the economic issues.
Showing 241–260 of 545 · page 13 of 28 ← Previous Next →