Lennart Heim
👤 PersonAppearances Over Time
Podcast Appearances
Yeah, I think I don't want to go forward and say it is this, right?
I'm just saying it's like, look, there has been this hyper focus on benchmark capabilities on chatbot arena to measure the AI US rates.
I was like, man, I think it's more complicated.
Eventually, it really depends what you want to measure and what you're worried about.
If I care about national security, I measure different things than if I care about like economic diffusion, right?
To some degree for national security, I might not even care about how many users are using a chatbot to get better cooking recipes.
Right.
But I care a lot about if you have, I don't know, a million drones embedded with AI or like two drones embedded with AI.
Right.
So the argument which I'm just putting forward is more just like we need to understand how export controls, which the US government is doing on its AI chips, are actually working.
What to expect and what not to expect, right?
I think there's a world where like pure raw model capabilities matter a ton.
It depends how you think the iFuture is going to go, right?
If there's going to be an Oracle in the future and it just tells me the truth to the universe, hell yeah.
And that's like, what, 10,000 tokens?
Amazing.
I think that's quite not plausible.
I think the future will just look way more complicated and it's actually about people using the systems.
Now we are saying this, like having a car is something, but you actually need to drive it, right?
And then it's not you driving it, everybody needs to drive it, right?