Andrej Karpathy

So NanoChat is a kind of a repository I released.

Was it yesterday or the day before?

I can't remember.

We can see this lead generation that went into the... Well, it's just trying to be a...

It's trying to be the simplest, complete repository that covers the whole pipeline end-to-end of building a ChatGPT clone.

And so, you know, you have all of the steps, not just any individual step, which is a bunch of... I worked on all the individual steps sort of in the past and released small pieces of code that kind of show you how that's done in algorithmic sense in like simple code.

But this kind of handles all the entire pipeline.

I think in terms of learning, it's not so much, I don't know that I actually found something that I learned from it necessarily.

I kind of already had in my mind as like how you build it.

And this is just a process of mechanically building it and making it clean enough and so that people can actually learn from it and that they find it useful.

I would probably say, so basically it's about 1,000 lines of code that takes you through the entire pipeline.

I would probably put it on the right monitor, like if you have two monitors, you put it on the right.

And you want to build it from scratch.

You build it from start.

You're not allowed to copy-paste.

You're allowed to reference, you're not allowed to copy-paste.

Maybe that's how I would do it.

But I also think the repository by itself, it is like a pretty large beast.

I mean, when you write this code, you don't go from top to bottom.

You go from chunks and you grow the chunks.