Azeem Azhar

We need to send that back.

And how do you train people about where that boundary is?

Yeah, and there are probably a few others, things like chatbots and teams, right?

Can you get an agreement of how old you should be before you can get to a certain class of chatbot?

And I think, you know, you discussed earlier about it's a bit jarring if the system always responds back to you as the system did this or the system, you know, did that.

But actually we are

willing to protect them to put our kids through more hurdles than we might put ourselves.

So I can see that there are some soft areas.

But you also, in your essay, talked about certain hard lines, right?

The systems that set their own goals, that improve their own code, that can act autonomously, that these things cross into

dangerous territory.

But in some sense, goal setting, self-improvement and autonomous action are exactly some of the things that make AI agents really useful.

I mean, if an AI can't set up sub-goals and spin up

parallel processes in a way where restricting it to autocomplete, and if it can't act without constant human-in-the-loop coordination approvals, we lose all of those coordination costs.

We end up being the bottleneck and where it's as slow as the slowest link.

I have a feeling, and we'll move on to another topic in a second, that this is going to be a bit like the Meard Street beer flood.

So this happened in the late 18th century in what is now the West End of London and an enormous brewery collapsed and people drowned in tens of thousands of gallons of ale and

And what came out of that were better building regulations.

And I just get a sense that the speed of movement, of improvement and distribution and deployment, and I think we crossed some kind of a technical milestone late last year where you didn't have to be a foundation lab, a super intelligence lab.

to be able to chain a lot of these things together and do truly remarkable things, which is what, you know, Molbot or Claude is.