Will Douglas Heaven
๐ค SpeakerAppearances Over Time
Podcast Appearances
So these models are just a lot of math and a lot of numbers, but that's hard to visualize.
Certainly when I was about to write an article, I'm sure we'll get into this, I was going to write about the people trying to make sense of what these things even are and what they do.
I wanted to give a release of vivid
way of picturing them.
So yeah, they said, like, if you were to print these numbers out on paper, they would basically cover San Francisco.
And that's just absolutely insane.
Yeah, yeah.
I mean, there's a mind-boggling number of computations that happen, even for a simple request.
And we're all familiar now, you type a request into a model and you get an answer back between what you type and what you get back.
Truly an insane number of calculations.
And it's not just that there are a lot of them and you wouldn't be able to sort of follow them all.
But exactly, I mean, another way of thinking about it, you imagine these were just a vast, vast pinball machine.
And your sentence you put in is like the ball and you have billions of paddles whacking a paddle over the place.
And it's hard to say, you know, which paddle would be activated when and how.
And why?
Yeah.
And why, exactly, and why.
So yeah, it's impossible in practice to follow the input all the way from your typing to what you get out.
But obviously, that's a problem, right?
Even the people making these don't understand exactly how they work.