Dylan Patel
๐ค SpeakerAppearances Over Time
Podcast Appearances
It's eight, right?
Like it's thinking through it, right?
Like you and I would solve a Sudoku.
Now, eventually when you get good enough at Sudoku, you could probably just like spit out an answer.
You could do it in your sleep.
This reasoning time is a way of spending more compute, more brain cycles on the task without actually scaling the model.
And then the model becomes more versatile, right?
Because humans have
A rate.
If I just held a match against you and you didn't notice it, you'd immediately jerk.
The rate at which you operate is hundreds of hundreds of Hertz.
Your body can actually take actions at like hundreds of actions per second.
If you look at like a fighter pilot's reaction time, what reaction can they do is like completely like primal instinctual, right?
Very little thought is put into it.
This alien intelligence that we're trying to make, is it immediately going to one shot the answer always?
No, but like, you know, at times it needs to.
At times it needs to be able to tell me exactly the answer in like two seconds or half a second or whatever action it needs to take immediately.
But a lot of times also needs to think through the problem, go and do stuff.
That's why you hire interns because you're like, yeah, I know this data exists.
Here's the format I kind of want it on.