That’s an interesting article. We could contrast “powerful optimizers” and “asteroid strikes” or other natural disasters this way: an asteroid strike is dangerous because it could greatly increase entropy on earth. A powerful optimizer is very dangerous because it could greatly decrease it.
ETA: I’m not as sure as I was when I said this last week. I was thinking of entropy as a relationship. But now I’m finding it hard to figure out exactly what the relationship is between.
That’s an interesting article. We could contrast “powerful optimizers” and “asteroid strikes” or other natural disasters this way: an asteroid strike is dangerous because it could greatly increase entropy on earth. A powerful optimizer is very dangerous because it could greatly decrease it.
An optimizer could be trying to maximize entropy on Earth.
No it can’t. Entropy is not an absolute property.
ETA: I’m not as sure as I was when I said this last week. I was thinking of entropy as a relationship. But now I’m finding it hard to figure out exactly what the relationship is between.
I think you could be very good at creating entropy without being very smart.