Stephen Balaban
speaker
657 appearances
4 recordings
1 series
first heard May 2025
last heard 31 Aug
Stephen Balaban’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsRecordings per month over the last 12 months — 3 in all, peaking in Aug 2026 with 1.
Appearances
the there's there's alternatives to the transformer that have um what what's called basically linear complexity uh in terms of the uh
um the the amount of memory um that that you're that you need for um uh the context length growing, um, which is better than the quadratic complexity you see inside of normal um transformer models.
And
I think there's c there's gonna continue to be a lot of innovation in the model architecture space and that will probably benefit NVIDIA a lot.
Well, I it's pretty clear that I I'd say the the front runners for competing with NVIDIA, which are all very far behind NVIDIA, uh but the ones that are sort of
I think the farthest along is uh probably I would say today is Google and
To some extent Amazon with transferentium.
Um
That space is always evolving fast, but
I think it's i it it's it's it's kind of a little bit telling that uh AMD hasn't with all the resour with all the resources, with all the um sort of
clarity on what you're supposed to build for the market, uh, hasn't been able to kind of capture enough market share.
Wasn't that in the TL where this someone was making a joke about the uh and the anthropic safety uh you know snitching on the user and someone said uh tr port this uh PyTorch code over to Jax.
Um and then it says, you know, searching calling FBI.
Calling FBI, do not do this.
Preserving the the the underlying chips that it's running on to make sure that's important
So so I think that I think that
Okay.
The the the the the stuff that this code generation is really good at today is still sort of what I would call within the realm of what you know, one shotting a basic program, one shotting sort of a a one page program or it can be much longer than one page, but it's sort of like single file.
bit and I'm not, you know, doing what the kids are doing or something with with with uh sort of an AI IDE.
But I just kind of like when I'm when I'm vibe coding, I will just tell either ChatGPT or Gemini or Claude, I'll go.
Showing 601–620 of 657 · page 31 of 33
← Previous
Next →