David Duvenaud

Because if you're increasing the rate at which everyone is making digital clones of themselves, then maybe in a sense you're contributing to the race to the bottom.

So I mean, I've said to Luca and Rudolf, so I think you guys are...

going to be good for the world in the sense like that on topic is where you get to be the ones that say there's other guys are maniacs, right?

Like the mechanized allows people are really just trying to take away everyone's bargaining power and their own like value ads.

So you guys should all be mad at them, but it's also bad in the same way that I thought was bad where they're like doing almost the same thing.

And they're sort of like affording many of the same dangers in the long run.

And so they're trying to say, okay, well, yeah, let's try to bind.

Let's try to like come up with some creative mechanism to bind ourselves to only do the good thing.

It's not clear what that mechanism could look like though.

Absolutely, yeah.

Yeah, I guess one of the other things that we're trying to flesh out is actually the details of, wait, wait, wait, how do we actually lose control if we have the aligned AGIs?

And I've tried to make this pitch, but obviously we've just started thinking about this.

And so actually me and my co-authors have been working with a math scholar, Gideon Fuderman, who's been trying to

make a more detailed case of like, here are all the avenues by which we're in a situation where we actually could shut down the AI or modify it or whatever, but we end up building institutions that don't serve us.

And so trying to flesh that out, I feel like there should be a lot more work in that direction.

Yeah, so I think it's basically beyond their scope to address, but it's not beyond their scope to monitor and sort of like help us understand what's happening.

So, I mean, I really like the Anthropic Economic Index or like where they're trying to say, like, what jobs are people actually doing and how are these models being used?

And I think more of that and like for more companies and more expansive is going to actually help people understand what's happening and just these dynamics a little bit better.

I will say that all the people that I talk to, in general, people are sympathetic to this.

I mean, some people are kind of a bit head in the sand or dismissive, but I think a lot of people there are just like, oh yeah, that's a huge problem.