The goal of maximizing paperclips is chosen for illustrative purposes because it is very unlikely to be implemented
I thought that it was chosen in part for a story like: a paperclip manufacturer wants an AI to help it better manufacture paperclips.
I thought that it was chosen in part for a story like: a paperclip manufacturer wants an AI to help it better manufacture paperclips.