Daniel Kokotajlo

But also you're increasing the risk of the arms race in the first place.

Like China is more likely to do an arms race if it sees the U.S.

doing one.

Before you address, I guess, the initial question about the March 2021, what will we regret?

I wonder if you have an answer on that.

Or your reaction to my point about nationalization being bad for these reasons?

I don't know.

It already exists.

Yeah.

This is actually a significant part of your worldview, so can you explain...

Yeah, your thoughts on why transparency through this period is important.

Let me just add on to that one of the many other reasons why I worry about nationalization or some kind of public-private partnership or even just very stringent regulation.

Actually, this is more an argument against very stringent regulation in favor of safety rather than deferring more to the labs on the implementation.

is that it just seems like we don't know what we don't know about alignment.

Every few weeks, there's this new result.

OpenAI had this really interesting result recently where they're like, hey, they often tell you if they want to hack, like in the chain of thought itself, and it's important that you don't train against

the chain of thought where they tell you they're going to hack because they'll still do the hacking if you train against it.

They just won't tell you about it.

You can imagine very naive regulatory responses.

It doesn't just have to be regulations.