Vibhu (Vibhu?)
speaker
157 appearances
1 recordings
1 series
first heard Jul 2026
last heard 23 Jul
Vibhu (Vibhu?)’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jul 2026 with 1.
Appearances
Like literally the page two of Tech Report is this process allowed us to build the small model from scratch to delivery within five weeks, applying the lessons.
And then I'm like, oh, this paper is not about here's a tech report of benchmarks and here's how many tokens it was trained on.
Like for people that want to dive more from what we're not going to discuss on the podcast, it's all laid out here, right?
Yeah.
custom software that agents can use to interface with training code, pre-training data.
Yeah, yeah, all that stuff.
You know, read the paper here, but...
A lot of it's fun.
Like even just the one, you share all the ablations to picking the data sets, right?
There's like a random small, small paragraph in here where it's just like, oh yeah, pre-training data.
We have some, we have an auto mixer, you know, it trains eight small models, skills them up, picks the pre-training data set.
We don't even need to look at it.
I'm like, wow, a lot of engineering rigor there.
And there's just, you know, there's just a lot.
Which is the other cool side of this, right?
It's not like back to your point.
It's not just here's the benchmarks of our training.
If you want to replicate, here's experiments of optimizers, data sets, post-training.
You lay out a lot of it here alongside here's your system for how to do it, you know?
So it's really like promoting other people can do the same.
Showing 21–40 of 157 · page 2 of 8
← Previous
Next →