Nick Turley

Or was GPT-3 kind of it?

To, wow, actually this is an entire step change with

what felt to me at the time who didn't understand much about ai at all as like just some tweaks or some a little bit of final stretch work was profoundly humbling because you can realize that you might it might not look like we are close to really powerful useful ai but we probably are um and then the moment that you know really you know there was two things that gbd4 did that

felt like AGI to me.

One is it could do poetry, and I didn't think it was possible for any ML to do poetry.

Just kind of fundamental, philosophically, it just didn't feel like in scope.

And then the other one was it could produce code that actually worked and compiled.

And then my next moment where I stared at the ceiling just in awe was when I realized GPT-4 could just simulate an entire computer terminal.

um uh like a you know a full computer with commands etc and i'm like wait how would this be imbued in a in a language model there's been so many moments since then honestly like reasoning was a moment one of the moments was when i think mark and i were uh uh giving a demo of reasoning uh in front of the um whole company um

And this was a moment where we were still trying to kind of find use cases that were hard enough for the AI, for the reasoning team, make a difference.

We're way past that point, we know.

But at the time, I think we were having to do a puzzle in front of everyone.

And I think one of the moments that made me totally feel the AGI is like,

We were in the middle of the demo, and everyone started laughing.

And I was like, wait, what is funny?

And then I stared at the screen, because we were showing this chain of thought as it was streaming out of the model.

And the model swore and said, oh, damn it.

May have to adjust, because it realized it had made a mistake in the puzzle.

And the fact that it did that, but particularly the fact that it did that in a way that was entirely emergent from the RL process, completely blew my mind and made me feel quite humble about what else these models might be able to do.

So that was one of those moments.