Andrej Karpathy

I do think you need someone in a powerful position with a big hammer like Elon, who's like the cheerleader for that idea and ruthlessly pursues it.

If no one has a big enough hammer, everything turns into committees, democracy within the company, process, talking to stakeholders, decision-making, just everything just crumbles.

If you have a big person who is also really smart and has a big hammer, things move quickly.

I wouldn't say that setting impossible goals exactly is a good idea, but I think setting very ambitious goals is a good idea.

I think there's what I call sublinear scaling of difficulty, which means that 10x problems are not 10x hard.

Usually 10x harder problem is like 2x or 3x harder to execute on.

Because if you want to improve a system by 10%, it costs some amount of work.

And if you want to 10x improve the system, it doesn't cost...

you know, a hundred X amount of the work.

And it's because you fundamentally change the approach.

And if you start with that constraint, then some approaches are obviously dumb and not going to work.

And it forces you to reevaluate.

And I think it's a very interesting way of approaching problem solving.

Yeah.

I mean, I think a good example here is, you know, the deep learning revolution in some sense, because you could be in computer vision at that time during the deep learning sort of revolution of 2012 and so on.

You could be improving a computer vision stack by 10%, or we can just be saying, actually, all of this is useless.

And how do I do 10x better computer vision?

Well, it's not probably by tuning a hog feature detector.

I need a different approach.

I need something that is scalable.