Nathan Benaich
speaker
623 appearances
1 recordings
1 series
first heard Nov 2024
last heard Nov 2024
Nathan Benaich’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
And then the second thing is that these models would be so expensive to run, like there's no margin in it.
And that one seems to be changing a little bit, like whether it's just the the sheer cost drop from
You know, the most expensive models like a Euro ago to now.
I don't know, the most expensive one is maybe like six hundred dollars sorry, sixty dollars per million tokens.
And now the cheapest one is probably like zero point zero six dollars per million tokens.
Not the same level of intelligence, but not that far off.
So I think most people I talk to who are close to the coalface working on inference improvement say that you will likely have similar quality of intelligence for much lower price and much smaller models as we kind of improve things like knowing what pre training data to feed it, the sort of idea of curriculum learning, like very much
The analogy to going to school, like you don't get taught physics like PhD when you're like ten years old.
You get taught like the simpler stuff first.
Um
And then things like how to refine post training, um, like what kind of example should you give it?
Um and just given that I think we we we probably forget to include this, but
But until like
Chat G BT and AI became super hypey.
I there were not that many contributors who actually worked in this field.
Um
I think there were some some data from various firms we included in prior reports, but it was like, I don't know, a hundred thousand like machine learners in the world, a million machine learners in the world, like really small numbers.
And now I think you have everybody who who spent, you know, years doing
Uh ad optimization, infrastructure optimization, like
DevOps, like all this stuff of making software run really fast.
Showing 221–240 of 623 · page 12 of 32
← Previous
Next →