Joscha Bach

The philosopher Thomas Metzinger is very concerned that the creation of superhuman intelligence would lead to superhuman suffering. And so he's strongly against it. And personally, I don't think that this happens because suffering is not happening at the boundary between... ourself and the physical universe. It's not some stuff on our skin that makes us suffer.

It happens at the boundary between self and world, right? And the world here is the world model. It's the stuff that is created by your mind. It's a representation of how the universe is and how it should be and how you yourself relate to this. And at this boundary is where suffering happens. So suffering in some sense is self-inflicted, but not by your personal self.

It happens at the boundary between self and world, right? And the world here is the world model. It's the stuff that is created by your mind. It's a representation of how the universe is and how it should be and how you yourself relate to this. And at this boundary is where suffering happens. So suffering in some sense is self-inflicted, but not by your personal self.

It happens at the boundary between self and world, right? And the world here is the world model. It's the stuff that is created by your mind. It's a representation of how the universe is and how it should be and how you yourself relate to this. And at this boundary is where suffering happens. So suffering in some sense is self-inflicted, but not by your personal self.

It's inflicted by the mind on the personal self that experiences itself as you. And you can turn off suffering when you are able to get on this outer level. So when you manage to... understand how the mind is producing pain and pleasure and fear and love and so on, then you can take charge of this and you get agency of whether you suffer.

It's inflicted by the mind on the personal self that experiences itself as you. And you can turn off suffering when you are able to get on this outer level. So when you manage to... understand how the mind is producing pain and pleasure and fear and love and so on, then you can take charge of this and you get agency of whether you suffer.

It's inflicted by the mind on the personal self that experiences itself as you. And you can turn off suffering when you are able to get on this outer level. So when you manage to... understand how the mind is producing pain and pleasure and fear and love and so on, then you can take charge of this and you get agency of whether you suffer.

Technically, what pain and pleasure is, they are learning signals, right? A part of your brain is sending a learning signal to another part of the brain to improve its performance. And sometimes this doesn't work because this trainer who sends the signal does not have a good model of how to improve the performance.

Technically, what pain and pleasure is, they are learning signals, right? A part of your brain is sending a learning signal to another part of the brain to improve its performance. And sometimes this doesn't work because this trainer who sends the signal does not have a good model of how to improve the performance.

Technically, what pain and pleasure is, they are learning signals, right? A part of your brain is sending a learning signal to another part of the brain to improve its performance. And sometimes this doesn't work because this trainer who sends the signal does not have a good model of how to improve the performance.

So it's sending a signal but the performance doesn't get better and then it might crank up the pain and it gets worse and worse and the behavior of the system may be even deteriorating as a result. But until this is resolved, this regulation issue, your pain is increasing. And this is, I think, typically what you describe as suffering.

So it's sending a signal but the performance doesn't get better and then it might crank up the pain and it gets worse and worse and the behavior of the system may be even deteriorating as a result. But until this is resolved, this regulation issue, your pain is increasing. And this is, I think, typically what you describe as suffering.

So it's sending a signal but the performance doesn't get better and then it might crank up the pain and it gets worse and worse and the behavior of the system may be even deteriorating as a result. But until this is resolved, this regulation issue, your pain is increasing. And this is, I think, typically what you describe as suffering.

So in this sense, you could say that pain is very natural and helpful, but suffering is the result of a regulation problem in which you try to regulate something that cannot actually be regulated. And that could be resolved if you would be able to get at the level of your mind where the pain signal is being created and rerouted and improve the regulation. And a lot of people get there, right?

So in this sense, you could say that pain is very natural and helpful, but suffering is the result of a regulation problem in which you try to regulate something that cannot actually be regulated. And that could be resolved if you would be able to get at the level of your mind where the pain signal is being created and rerouted and improve the regulation. And a lot of people get there, right?

So in this sense, you could say that pain is very natural and helpful, but suffering is the result of a regulation problem in which you try to regulate something that cannot actually be regulated. And that could be resolved if you would be able to get at the level of your mind where the pain signal is being created and rerouted and improve the regulation. And a lot of people get there, right?

If you are a monk who is spending decades reflecting about how their own psyche works, you can get to the point where you're they realize that suffering is really a choice. And you can choose how your mind is set up. And I don't think that AI would stay in the state where the personal self doesn't get agency or this model of what the system has about itself.

If you are a monk who is spending decades reflecting about how their own psyche works, you can get to the point where you're they realize that suffering is really a choice. And you can choose how your mind is set up. And I don't think that AI would stay in the state where the personal self doesn't get agency or this model of what the system has about itself.

If you are a monk who is spending decades reflecting about how their own psyche works, you can get to the point where you're they realize that suffering is really a choice. And you can choose how your mind is set up. And I don't think that AI would stay in the state where the personal self doesn't get agency or this model of what the system has about itself.

It doesn't get agency how it's actually implemented. It wouldn't stay in that state for very long.