Stephen McAleese

The existence proof that confirms this belief is the existence of humans.

Humans had more general intelligence than other animals and ended up completely changing the world as a result.

2.

ASI is possible and likely to be created in the near future.

Assuming that current trends continue, humanity will probably create an artificial superintelligence, ASI, that vastly exceeds human intelligence in the 21st century.

Since general intelligence is powerful and is likely to be implemented in AI, AI will have a huge impact on the world in the 21st century.

3.

ASI alignment is extremely difficult to solve.

Aligning an ASI with human values is extremely difficult and by default an ASI would have strange alien values that are incompatible with human survival and flourishing.

The first ASI to be created would probably be misaligned, not because of malicious intent from its creator, but because its creators would be insufficiently competent enough to align it to human values correctly.

For a misaligned ASI would cause human extinction and that would be undesirable.

Given claims 1, 2, and 3 the authors predict that humanity's default trajectory is to build a misaligned ASI and that doing so would cause human extinction.

the authors consider this outcome to be highly undesirable and an existential catastrophe.

Any of the four core claims of the book could be criticized.

Depending on the criticism and perspective, I group the most common perspectives on the future of AI into 4.

Camps 1.

AI skeptics Believe that high intelligence is overrated or not inherently safe.

For example, some people argue that smart or nerdy people are not especially successful or dangerous, or that computers and LLMs have already surpassed human intelligence in many ways and are not dangerous.

Another criticism in this category is the idea that AIs can be extremely intelligent but never truly want things in the same way that humans do and therefore would always be subservient and harmless.

Others in this camp may accept that general intelligence is powerful and influential but believe that ASI is impossible because the human brain is difficult to replicate, that ASI is very difficult to create, or that ASI is so far away in the future that it's not worth thinking about.