I think at this point we’re hitting on the question of whether truly correct definitions exist. I believe Eliezer had some articles in the past about thingspace and ‘carving reality at its joints’, but, while this assumption underlies my article, I do see your point. In this case you would say that the algorithm has approached the ‘true characteristic’ when humans cannot discern any better than it can.
I guess one example is a guy who wrote a few articles for Hacker News, they got reasonably upvoted, and then he came out and said that he was producing them based on some underlying assumptions about what would do good on HN. Some people were negative and felt manipulated, but not everyone agreed that this was spam. The argument was “if you upvoted it, then you enjoyed it, and what the process that produced the article was shouldn’t matter”.
If you consider that spam, then certainly it’s spam beyond the human capability to detect it. But what you really need there is a process to infer intention, which may well be impossible.
I think at this point we’re hitting on the question of whether truly correct definitions exist. I believe Eliezer had some articles in the past about thingspace and ‘carving reality at its joints’, but, while this assumption underlies my article, I do see your point. In this case you would say that the algorithm has approached the ‘true characteristic’ when humans cannot discern any better than it can.
I guess one example is a guy who wrote a few articles for Hacker News, they got reasonably upvoted, and then he came out and said that he was producing them based on some underlying assumptions about what would do good on HN. Some people were negative and felt manipulated, but not everyone agreed that this was spam. The argument was “if you upvoted it, then you enjoyed it, and what the process that produced the article was shouldn’t matter”.
If you consider that spam, then certainly it’s spam beyond the human capability to detect it. But what you really need there is a process to infer intention, which may well be impossible.