Eli said: I encounter wannabe AGI-makers who say, “Well, I don’t know how to make my math work for an infinite time horizon, so… um… I’ve got it! I’ll build an AGI whose planning horizon cuts out in a thousand years.”
I’m not sure if you’re talking about me. I have said that I think we need some sort of bounded utility function, but that doesn’t mean it has to be an integral of discounted time-slice values.
Eli said: I encounter wannabe AGI-makers who say, “Well, I don’t know how to make my math work for an infinite time horizon, so… um… I’ve got it! I’ll build an AGI whose planning horizon cuts out in a thousand years.”
I’m not sure if you’re talking about me. I have said that I think we need some sort of bounded utility function, but that doesn’t mean it has to be an integral of discounted time-slice values.