David Cox
speaker
634 appearances
1 recordings
1 series
first heard Jan 2026
last heard 13 Jan
David Cox’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jan 2026 with 1.
Appearances
I think we're all going to start using weird words.
But also, with the 4.0 generation, we've just also made big strides in every part of our pipeline.
And this is the reason why, again, we were able to hack more and more capability into smaller and smaller models.
We were just figuring it out little bit by little bit.
It's on the data side and pre-training.
It's on the post-training.
It's on how we do RL.
It's on everything.
And that just keeps moving that direction.
But yeah, that's the vibe we're kind of going for.
So glad you're picking up the vibe that we were- Yeah, very much.
Yeah, I think if you do a little bit too much of that in the small models, they'll just kind of go off the rails and kind of go wrong.
But, you know, it's interesting.
All these things can be tuned, though, and they actually can be controlled as well.
Like, we're starting to also release adapters with the models, like suites of adapters.
And we have a new technology called an activated low-rank adapter.
Low-rank adapters, that's something that Microsoft invented.
You basically change the weights of the model a little bit, like in a linear algebra sense.
And you can get different behaviors out of the model.
But we figured out a way basically where you, while something's going on, the model's doing stuff, it's doing this genetic thing, you'd be like, well, actually right now I want these weights.
Showing 121–140 of 634 · page 7 of 32
← Previous
Next →