L. Rudolph L

But there is an opposite failure mode that Yudkowsky's framework does not adequately address.

The person who follows arguments wherever they lead without any check on whether the conclusions make sense.

This person is not engaging in motivated reasoning.

They are engaging in unmotivated reasoning, deduction without sanity checks.

Kirlorv is the prototype.

Kiyolov has arrived at the conclusion that suicide is the ultimate act of human freedom, the assertion of human will against the universe that created it.

He plans to kill himself as a kind of metaphysical demonstration, and he has agreed to leave a suicide note taking responsibility for crimes committed by Pyotr Stepanovich's revolutionary cell.

End quote.

The author compares Kiyolov to people who accept Pascal's wager type EV calculations about positive singularities.

A better example might be the successionists, some of who want humanity to collectively commit suicide as the ultimate act of human moral concern towards future AIs.

Shigalievism.

Shigalyov rises to present his system for organizing society.

I have become entangled in my own data, he begins, and my conclusion directly contradicts the original idea from which I started.

Starting from unlimited freedom, I end with unlimited despotism.

I will add, however, that apart from my solution of the social formula, there is no other.

One character asks whether this is not simply a fantasy.

Shigalyov replies that it is the inevitable conclusion of any serious attempt to organize society rationally.

All other solutions are impossible because they require human nature to be other than it is.

Only by eliminating freedom for the many can freedom be preserved for the few, and only the few are capable of handling freedom without destroying themselves and others.

the company reacts with fascination, horror, and a certain amount of admiration.