Emad Mostaque
speaker
1,351 appearances
1 recordings
1 series
first heard Dec 2024
last heard Dec 2024
Emad Mostaque’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
Decentralized training doesn't really make that much sense versus decentralized tuning.
Having armies of agents improve the data sets.
But DLOC, Distro and others have shown
really interesting kind of advances.
And again, like I said, I'm on the advisory board of some of these.
And the crypto XAI space is now like 40 billion dollars.
You look at something like BitTensor, that's a $12 billion network that's trading hundreds of millions of dollars a day for optimization.
It's like the most on steroids Kaggle you can see.
Um you have millions of GPUs in the other network available.
I think again the data side will be more interesting and again this sequential stuff as we get O one type models that can run on my M four Max or now M two Max soon to be M4 Max.
Looking forward to it.
Nanotexture display.
The probably one area that is probably most important to properly decentralizing this and ownership and control and governance is verifiable inference.
And again, we're making some big advances in there.
Hyperbolic and Alura and others are doing a lot of work around that.
So that then anyone can contribute their compute.
But the data equation of this and building gold standard data sets is more important than the pre training.
For a pre training, just have a cluster.
And just train on that cluster.
Like it's not rocket science.
Showing 961–980 of 1,351 · page 49 of 68
← Previous
Next →