Marcus Hutter
speaker
912 appearances
1 recordings
1 series
first heard Feb 2020
last heard Feb 2020
Marcus Hutter’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
Yeah, so you have a planning problem up to horizon M, and that's exponential time in the horizon M, which is, I mean, it's computable, but intractable.
I mean, even for chess, it's already intractable to do that exactly for Go.
But it could be also discounted kind of framework where... Yeah, so having a hard horizon at 100 years, it's just for simplicity of discussing the model, and also sometimes the math is simple.
But there are lots of variations.
It's actually a quite interesting parameter.
There's nothing...
really problematic about it, but it's very interesting.
So for instance, you think, no, let's let the parameter m tend to infinity, right?
You want an agent which lives forever, right?
If you do it naively, you have two problems.
First, the mathematics breaks down because you have an infinite reward sum, which may give infinity, and getting reward 0.1 every time step is infinity, and giving reward 1 every time step is infinity, so equally good.
Not really what we want.
Other problem is that if you have an infinite life,
You can be lazy for as long as you want for 10 years and then catch up with the same expected reward.
And, you know, think about yourself or, you know, or maybe, you know, some friends or so.
If they knew they lived forever, you know, why work hard now?
You know, just enjoy your life, you know, and then catch up later.
So that's another problem with the infinite horizon.
And you mentioned, yes, we can go to discounting.
But then the standard discounting is so-called geometric discounting.
Showing 441–460 of 912 · page 23 of 46
← Previous
Next →