Was it UDT1.1 (as a solution to this problem) that violates the Vingean principle?
As I remarked in that thread, there are many possible designs that violate the Vingean principle, AFAICT UDT 1.1 is one of them.
Also, I’m wondering if Benja’s polymorphism approach solves the “can’t decide whether or not to commit suicide” problem that I described here. Your paper doesn’t seem to address this problem since the criteria of action you use all talk about “NULL or GOAL” and since suicide leads to NULL, an AI using your criterion of action has trouble deciding whether or not to commit suicide for an even more immediate reason.
Suicide being permitted by the NULL option is a different issue from suicide being mandated by self-distrust. Benja’s TK gets rid of distrust of offspring. Work on reflective/naturalistic trust is ongoing.
As I remarked in that thread, there are many possible designs that violate the Vingean principle, AFAICT UDT 1.1 is one of them.
Suicide being permitted by the NULL option is a different issue from suicide being mandated by self-distrust. Benja’s TK gets rid of distrust of offspring. Work on reflective/naturalistic trust is ongoing.