4) Human values are not a natural category, there’s little to no chance that AI will converge on them by itself, unless specifically and precisely programmed.
Goertzel expressed doubt about step 4, saying that while it’s true that random AIs will have bad goals, he’s not working on random AIs.
That’s not really the same as asserting that human values are a natural category.
That’s not really the same as asserting that human values are a natural category.