Sholto Douglas
๐ค SpeakerAppearances Over Time
Podcast Appearances
If someone cares about some amount of RL on correctly interpreting the tax code.
I think it will get the taxes wrong.
It's like, okay, so if I went to you,
And I was like, I want you to do everyone's taxes in America.
What percentage of them are you going to fuck up?
By early 2026 or end of 2026?
End of.
The unreliability and incompetence stuff will be somewhat tricky to do this all the time.
Yeah, interesting.
I'm a bit of an end-to-end maxi.
I think in general, like,
when people are talking about the separate models.
So for example, most of the robotics companies are doing this kind of to the bi-level thing, where they have a motor policy that's running at whatever, like 60 hertz or whatever, and some higher level visual language model.
I'm pretty sure almost all the big robot companies are doing this.
And they're doing this for a number of reasons.
One of them is that they want something to act at a very high frequency.
And two is they can't train the big visual language model.
And so they like relying on that for general space, like world knowledge and this kind of stuff and like constructing longer running plans, but then they're like, you offload to the motor policy.
I'm very much of the opinion that if you are able to train the big model, eventually at some point in the future, the distinction between big models and small models should disappear because you should be able to use the amount of computation in a model that is necessary to complete the task.
Ultimately, there's some amount of task complexity.