You have not established that one ought to “do his best to increase his intelligence, his knowledge of reality and to help other ethical intelligent agents do the same”. Where is the jump from is to ought? I know Robin Hanson gave a talk saying something along those lines, but he was greeted with a considerable amount of disagreement from people whose ethical beliefs aren’t especially different from his.
That entails consistently resisting tyranny and exploitation.
If a tyrant’s goal was to increase their knowledge of reality and spread it which they chose to go about with violence and exploitation, resistance could very well hinder those goals.
But intelligence can be defined as the ability to predict and control reality or to put it another way to achieve goals.
That would make Azathoth incredibly intelligent, and Azathoth isn’t called the “blind idiot” for nothing.
So, if your only goal is to increase intelligence
You haven’t established that ought to be our goal.
You cannot increase intelligence indefinitely without eventually confronting the question of what other goals the intelligence you have helped to create will be applied to.
The intelligence might have no other goals other than those I choose to give it and the intelligence I am endlessly increasing might be my own.
That is a tricky question that our civilization does not have much success answering, and I am trying to do better.
Why is a “civilization” the unit of analysis rather than a single agent?
I assign most of the intrinsic good to obeying the Mugger
I do not and you have not established that I should.
the more intrinsic good gets heaped on obeying the Mugger.
You have not established that obeying the mugger will actually lead to preferable results.
You have not established that one ought to “do his best to increase his intelligence, his knowledge of reality and to help other ethical intelligent agents do the same”. Where is the jump from is to ought? I know Robin Hanson gave a talk saying something along those lines, but he was greeted with a considerable amount of disagreement from people whose ethical beliefs aren’t especially different from his.
That entails consistently resisting tyranny and exploitation.
If a tyrant’s goal was to increase their knowledge of reality and spread it which they chose to go about with violence and exploitation, resistance could very well hinder those goals.
But intelligence can be defined as the ability to predict and control reality or to put it another way to achieve goals.
That would make Azathoth incredibly intelligent, and Azathoth isn’t called the “blind idiot” for nothing.
So, if your only goal is to increase intelligence
You haven’t established that ought to be our goal.
You cannot increase intelligence indefinitely without eventually confronting the question of what other goals the intelligence you have helped to create will be applied to.
The intelligence might have no other goals other than those I choose to give it and the intelligence I am endlessly increasing might be my own.
That is a tricky question that our civilization does not have much success answering, and I am trying to do better.
Why is a “civilization” the unit of analysis rather than a single agent?
I assign most of the intrinsic good to obeying the Mugger
I do not and you have not established that I should.
the more intrinsic good gets heaped on obeying the Mugger.
You have not established that obeying the mugger will actually lead to preferable results.