Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Joe Carlsmith

๐Ÿ‘ค Speaker
1218 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Like, well, one important feature of these norms is that they're kind of effective and powerful.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Like liberal societies are, you know, like, you know, secure boundaries, save resources wasted on conflict, right?

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And like liberal societies are often more like, you know, they're better to live

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

live in, they're better to immigrate to, they're more productive, like all sorts of things.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Nice people, they're better to interact with, they're better to like trade with, all sorts of things, right?

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And I think it's pretty clear if you look at the, both like why at a political level do we have like various political institutions?

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And if you look kind of more deeply into our evolutionary past and like how our moral cognition is structured, it seems like pretty clear that various like kind of forms of cooperation and like kind of game theoretic dynamics and other things went into

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

kind of shaping what we now, at least in certain contexts, also treat as a kind of intrinsic or terminal value.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

So like,

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

these, some of these values that have kind of instrumental functions in our society are also get kind of reified in our cognition as kind of intrinsic values in themselves.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And I think that's okay.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

I don't think that's a debunking.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Like all of your, uh, all your values are kind of like some, something that kind of stuck and got kind of, uh, uh, treated as a terminal, terminally important.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Um, but I think that means that, uh,

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

You know, sometimes the way, in the context of the series where I'm talking about, like, deep atheism and our sort of relationship, the relationship between what we're pushing for and what, like, nature is pushing for or what sort of pure power we'll push for.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And it's easy to say, like, well, there's, like, paperclips, which is just, like, one way, place you can steer.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And, you know, pleasure is just, like, another place you can steer or something.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And these are...

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

just sort of arbitrary directions.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Whereas I think like some of our other values are much more structured around like cooperation and things that also are kind of effective and functional and like powerful.