Aza Raskin

and those plants started melting down.

We wouldn't tell everyday consumers, like citizens, just go buy hazmat suits.

It's your responsibility.

No, we'd hold the companies accountable for their designs and for their mess-ups.

We'd require safety frameworks before they ever got to operate.

We'd match the power of the technology, which is quite high, with the corresponding architectural responsibility.

And the crazy thing is, this isn't new.

This isn't hard to imagine.

The duty of care already exists in pretty much every other industry we trust with consequential power from medicine and aviation, automotive, construction.

We just don't do that for AI, for technology, not even close.

That's the weird thing that happens when you move from the physical domain to the digital domain.

Okay.

To our penultimate principle, principle six, respect human psychology, don't exploit it.

So there's a graph that we sometimes draw for people and it's the power of technology is going up exponentially and everyone's been watching out for the place where the power of technology overwhelms human strengths.

And that actually seems to be happening about now with AI.

But there's a much earlier point when technology undermines human weakness or human vulnerability.

And that's really what this principle is all about.

Because as E.O.

Wilson, the father of evolutionary biology says, is that the problem humanity faces is that we have paleolithic emotions, medieval institutions, and godlike technology.

And it's that paleolithic emotions, paleolithic minds, that's the problem.