Menu
Sign In Search Podcasts Charts People & Topics Add Podcast API Blog Pricing
Podcast Image

Rationality: From AI to Zombies

Argument Screens Off Authority

04 Mar 2015

Transcription

Full Episode

0.402 - 23.428 Eliezer Yudkowsky

Argument screens off authority. Black Belt Bazian, aka Steven, tries to explain the asymmetry between good arguments and good authority, but it doesn't seem to be resolving the comments on my blog post, Reversed Stupidity is Not Intelligence, so let me take my own stab at it. Scenario one. Barry is a famous geologist.

0

24.108 - 47.73 Eliezer Yudkowsky

Charles is a 14-year-old juvenile delinquent with a long arrest record and occasional psychotic episodes. Barry flatly asserts to Arthur some counterintuitive statement about rocks, and Arthur judges it 90% probable. Then, Charles makes an equally counterintuitive flat assertion about rocks, and Arthur judges it 10% probable.

0

48.532 - 74.06 Eliezer Yudkowsky

Clearly, Arthur is taking the speaker's authority into account in deciding whether to believe the speaker's assertions. Scenario 2. David makes a counterintuitive statement about physics and gives Arthur a detailed explanation of the arguments, including references. Ernie makes an equally counterintuitive statement, but gives an unconvincing argument involving several leaps of faith.

0

75.161 - 97.069 Eliezer Yudkowsky

Both David and Ernie assert that this is the best explanation they can possibly give to anyone, not just Arthur. Arthur assigns 90% probability to David's statement after hearing his explanation, but assigns a 10% probability to Ernie's statement. It might seem like these two scenarios are roughly symmetrical.

0

97.49 - 117.064 Eliezer Yudkowsky

Both involve taking into account useful evidence, whether strong versus weak authority or strong versus weak argument. But now suppose that Arthur asks Barry and Charles to make full technical cases with references and that Barry and Charles present equally good cases and Arthur looks up the references and they check out.

117.945 - 128.318 Eliezer Yudkowsky

Then Arthur asks David and Ernie for their credentials and it turns out that David and Ernie have roughly the same credentials. Maybe they're both clowns or maybe they're both physicists.

129.513 - 152.94 Eliezer Yudkowsky

Assuming that Arthur is knowledgeable enough to understand all the technical arguments, otherwise they're just impressive noises, it seems that Arthur should view David as having a great advantage in plausibility over Ernie, while Barry has at best a minor advantage over Charles. Indeed, if the technical arguments are good enough, Barry's advantage over Charles may not be worth tracking.

153.661 - 159.368 Eliezer Yudkowsky

A good technical argument is one that eliminates reliance on the personal authority of the speaker.

160.85 - 182.078 Eliezer Yudkowsky

Similarly, if we really believe Ernie that the argument he gave is the best argument he could give, which includes all the inferential steps that Ernie executed and all of the support that Ernie took into account, citing any authorities that Ernie may have listened to himself, then we can pretty much ignore any information about Ernie's credentials. Ernie can be a physicist or a clown.

Comments

There are no comments yet.

Please log in to write the first comment.