Trenton Bricken

Yeah, exactly.

Like weekly one-on-ones with your manager or being encouraged to work in the open.

Yeah.

Or, like, even with homework assignments, right?

They're so scaffolded.

It's always 10 questions broken down into subcomponents.

Yeah.

Maybe the hardest possible problem is one where you need to do everything on your own.

So I think, again, we take for granted how much we need to show humans how to do specific tasks, and there's like a failure to generalize here.

Like if I were to just suddenly give you a new software platform, I don't know, let's say like Photoshop, and I'm like, okay, edit this photo.

If you've never used Photoshop before, it'd be really hard to navigate.

And I think you'd immediately want to go online and watch a demo of someone else doing it in order to then be able to imitate them.

But we give that –

That amount of data on every single task, surely, to the models.

So this is the first thing.

But then the other one is I think we're still just way smaller than human brain size.

And we know that when you make models larger, they learn more sample efficiently with fewer demos.

And, like, it was striking where even in your recent podcast with Mark Zuckerberg and Lama, it's like a 2 trillion parameter model.

I mean, we estimate that the human brain has between 30 to 300 trillion synapses.

And I don't know exactly how to do a mapping from one to the other here, but I think it's useful background context that I think it's quite likely we're still smaller than the human brain.