Oly Sourbut

And we're not currently imagining that kind of entering into any kind of regulatory regime.

You could imagine, though, if it turns out best practices make it relatively easy, actually, to construct these systems, which are, on the whole, epistemically virtuous, you can imagine it being mandatory or semi-mandatory.

Like, well, why not just use those best practices?

Why not actually make sure your systems are kind of honest and legible?

It may even not be necessary at that point to regulate.

It might just be kind of, why wouldn't you do that?

Of course, there are always these kind of long tail of developers, especially open source and fine tuning and this kind of thing.

Like kind of anyone can make their own system.

If they want to make a lying bot, then they can do that.

And it's pretty hard to stop them doing that.

But people can already go around and lie.

So perhaps that's not, they're not going to get a reputation for honesty that way.

So maybe that's how we defend ourselves.

I think this gets back to the sort of

Aesthetic is the wrong word, but the point of AI for human reasoning is to enable and augment human reasoning, to have machines in the human loop, in Audrey Tang's words.

And to maintain those guarantees that people are at least kind of understanding what's going on.

But yeah, I guess I want to say a few things about that.

One thing that I think is maybe pernicious is

There's this kind of process in many industries where junior people come in, they do their time doing these like somewhat rote tasks.

They're learning by doing this, a kind of apprenticeship.