Bogoed

Discussion has died down as we began to feel relatively safe.

Now we can pretend that it was never serious.

You see this with AI too, already.

There are people who are sure that the alignment problem is exaggerated because chatbots already care about people enough and do not give out bomb recipes.

As if that were not a man-made miracle.

Somehow people infer that the problem was inconsequential, not that we responded properly this one time.

Humans are wired to notice events, not non-events.

People observe the post-intervention world and treat it as the baseline.

Prevention is invisible.

Because of that, people who prevent bad outcomes often get treated as though they've done nothing, or even as though they were dramatic for worrying.

Which is a pretty fucked up reward structure when you think about it.

If you work in safety of anything, you'll be told many times that your job is unimportant.

Some people find it comforting to think that if someone succeeded, then there was never a real problem to begin with.

Some are consciously fighting windmills and assume everyone else must be too.

And most people just don't think about catastrophes, you know, unless.

It's also psychologically harder to respect routine prevention than cinematic heroics.

People love the last-minute save, and they are not taught to clap for scheduled maintenance or tedious work.

But it's still just wrong.

Most of civilization runs on maintenance and prevention.

The world is being saved constantly.