John Schulman

And we have a pretty good handle on what it's going to do, what it can do.

So I think...

yeah we would have to be we'd have to be very careful um if it happened way sooner than expected because i think uh our understanding is rudimentary in a lot of ways still

Yeah, I would say just like maybe not training the even smarter version, not being really careful when you do train it, that it's not, it's like properly sandboxed and everything.

Maybe not deploying it at scale or, yeah, being careful

Yeah, being careful about what scale you deploy it.

Yeah, the game theory is a little tough to think through.

So first of all, I don't think this is gonna happen next year, but it's still useful to have the conversation and maybe it's like two or three years instead.

But yeah, I guess- Two or three years is still pretty soon.

Yeah, still pretty soon.

I do think you probably need some coordination.

Everyone needs to agree on some reasonable limits to deployment or to further training for this to work.

Otherwise you have the race dynamics where everyone's trying to stay ahead and that might require compromising on safety.

So I think you would probably need some coordination

uh larger entities that are doing this kind of training and so you're coordinating to um i guess pause deployment until until what exactly like until you figure out what's happening in the models uh either uh further training pause deployment uh like uh avoid certain types of training that we think might be riskier

So just like setting up some reasonable rules for like what everyone should do to, yeah, having everyone somewhat limit these things.

Yeah, that's... I don't have a good answer to that.

I mean, I would say...

um if we can if everyone is gonna coordinate like that uh i think we would be that would be an okay scenario that would be a pretty good scenario because i do think uh like um building these models is very capital intensive and uh there are a lot of complex pieces so it's not like everyone's gonna go and recreate this stuff at home

So I think it is possible to do, given the relatively small number of entities who could train the largest models, it does seem possible to coordinate.