Sometimes the cluster in the map a preference is pointing at involves another preference. Which provides a natural resolution mechanism. What happens when there’s two preferences, I’m unsure. I suppose it depends on how your map changes. In which case, I think you should focus on how to make purity coherent you should start off with some “simple” map and various “simple” changes in the map. To make purity coherent relative to your map is both computationally hard, and empathetically hard.
Side-note: It would be interesting to see which resolution mechanisms produce the most varied shifts in preferences for boundedly rational agents with complex utility functions.
Side-note^2: Stuart, I’m writing a review of all the work done on corrigibility. Would you mind if I asked you some questions on your contributions?
Sometimes the cluster in the map a preference is pointing at involves another preference. Which provides a natural resolution mechanism. What happens when there’s two preferences, I’m unsure. I suppose it depends on how your map changes. In which case, I think you should focus on how to make purity coherent you should start off with some “simple” map and various “simple” changes in the map. To make purity coherent relative to your map is both computationally hard, and empathetically hard.
Side-note: It would be interesting to see which resolution mechanisms produce the most varied shifts in preferences for boundedly rational agents with complex utility functions.
Side-note^2: Stuart, I’m writing a review of all the work done on corrigibility. Would you mind if I asked you some questions on your contributions?
No prob. Email or Zoom/Hangouts/Skype?
Hangouts I suppose. It just works. Would next weekend be OK for you?
Edit: I’ve scheduled a meeting for 12pm UK time on Saturday. Tell me if that works for you.
meet.google.com/kdf-xavk-nnh
Sorry, had a few terrible few days, and missed your message. How about Friday, 12pm UK time?
Alright, here’s the link for Friday: meet.google.com/qxw-zpsi-oqn
Thanks for replying.