Ethan He
speaker
722 appearances
1 recordings
1 series
first heard Jun 2026
last heard 1 Jun
Ethan He’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 1 in all, peaking in Jun 2026 with 1.
Appearances
So at NVIDIA, I was mainly focusing on scaling.
So one thing is Cosmos, scaling the video distribution models to...
to a few billion parameters.
And another thing is I was working on MOEs.
The Megatron MOEs was the first, was the first framework open source to be able to train these MOEs at very large scales, like a hundred billion parameters to even trillions parameters efficiently at like 40% MFU.
And going to switching to XAI was trying to work on even larger compute scale even further.
And yeah, looking at this trajectory, I actually worked on a lot of different things.
So I feel actually within ML,
it's actually easier to switch than you think.
A lot of people might have mindsets that, oh, I work on computer vision, I always have to work on computer vision, and I cannot switch to language.
But from my experience, at least that...
At NVIDIA, I worked on both language model MOEs and also video models.
It's actually not the case of others, but also the core principles, how to train large models are largely the same.
And yeah, for me, I feel right now the bottleneck for video models is actually the language part.
the agent, which is why I want to go to work more on RLMs.
One thing is it's a bit of a challenge.
I don't think it's a huge jump.
Yeah.
Yeah.
I'll share more about my next chapter soon.
Showing 701–720 of 722 · page 36 of 37
← Previous
Next →