Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing

Joe Carlsmith

๐Ÿ‘ค Speaker
1218 total appearances

Appearances Over Time

Podcast Appearances

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

This is a bad deal.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

You're holding hostage your commitment to, to not being burned alive or like your care for that to this like abstruse, like basically your, your, um,

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Yeah, like I think, I mean, I go through in the essay a bunch of different ways in which I think this is wrong, but I think just like, and I think these people who kind of pronounce, they're like moral realism or the void, like they don't actually think about bets like this.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

I'm like, no, no, okay, so really, like, is that what you want to do?

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And no, I think we should, I still care about my value, my sort of allegiance to my values, I think is kind of outstrips the, my like commitments to like various like meta-ethical interpretations of my values.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

I think like we should,

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

the sense in which we like care about not being burned alive is much more solid than like our kind of, you know, than the reasoning and on what matters.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Okay, so that's like the sort of philosophical doom.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Now you could have this, it sounded like you were also gesturing at a sort of empirical doom.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Right.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Which is like, okay, dude, if it's all, if it's just going in a zillion directions,

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

come on, you think it's going to go in your direction?

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Like, there's going to be so much churn.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

Like, you're just going to lose.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And so, you know, you should give up now and kind of only fight for the realism worlds.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

And there I'm like, I mean, so I think...

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

You know, you got to do the expected value calculation.

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

You got to, like, actually have a view about, like, how doomed are you in these different worlds?

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

What's the tractability of changing different worlds?

Dwarkesh Podcast
Joe Carlsmith - Otherness and control in the age of AGI

I mean, I'm quite skeptical of that.