Rob Wiblin

I guess you trust yourself and your colleagues to broadly act reasonably when the time comes, which means that it's very natural that you don't want to completely tie your hands.

You want to maintain flexibility to do whatever seems reasonable to you at the time.

But I imagine other people externally...

They either don't trust you and your colleagues or they aren't sure whether to trust you and your colleagues.

Yeah, tell us more about that.

What do you think is useful?

Tell us about AI LabWatch.

What useful function do you think it's serving now?

Okay.

And the way that that's different than the kind of broad commitments that companies have tended to be making the last couple of years is that you can have technical experts working at this AI lab watch organization, constantly updating it, I guess, paying a lot of attention to detail about exactly what are the things that

practices that companies engage in or don't engage in that make a big difference and constantly updating it based on newest opinions or newest research about what actually matters.

So you gave us an example of a reversal of opinion about what AI companies ought to be doing before.

Before people thought you should be training on this data, now they think you should be taking a lot of care to cut it out instead.

But surely there are some things that are like some commitments that are broad enough or nonspecific enough or just like so obviously good that it is reasonable to commit to them.

For example, you could have a commitment to provide the kinds of information that an AI lab watch would require to rate whether Google DeepMind or any other company is doing a good job.

Or you were saying you think it's useful to have expert auditors.

People running evals, I guess having enough access to run sophisticated evals on the models to understand are they dangerous in this or that way.

You could commit to provide access to any external auditor or evaluator that meets a particular set of reasonable requirements.

What about those kinds of commitments?

This is saying personnel is policy.