There’s also lots of artistic concepts where the dependence on the medium is highly significant
Great examples. I agree the physical medium is really important in human art: see my Section 1.3.1.
It seems like it’s not a surprise that NNs would be good at perspective compared to humans, since there’s a cleaner inverse between the perceptive and the creation of perspective from the GAN’s point of view than the human’s (who has to use their hands to make it, rather than their inverted eyes).
I like the point about hands vs. “inverted eyes”. At the same time, the GANs are trained on a huge number of photos, and these photos exhibit a perfect projection of a 3D scene onto a finite-size 2D array. The GAN’s goal is to match these photos, not to match 3D scenes (which it doesn’t know anything about). Humans invented perspective before having photos to work with. (They did have mirrors and primitive projection techniques.)
I think most humans have pretty good facility with creating and understanding ‘stick figures’ that comes from training on a history of communicating with other humans using stick figures, rather than simply generalizing from visual image recognition,
I agree that our facility with stick figures probably depends partly on the history of using stick figures. However, I think our general visual recognition abilities make us very flexible. For example, people can quickly master new styles of abstract depiction that differ from the XKCD style (say in a comic or a set of artworks). DeepMind has a cool recent paper where they learn abstract styles of depiction with no human imitation or labeling.
We might want to look for find concepts that are easier for humans than NNs; when I talk to people about ML-produced music, they often suggest that it’s hard to capture the sort of dependencies that make for good music using current models (in the same way that current models have trouble making ‘good art’ that’s more than style transfer or realistic faces or so on; it’s unlikely that we could hook a NN up to a DeviantArt account and accept commissions and make money).
Currently humans play a major role in the interesting examples of neural art. Getting more artist-like autonomy is probably AI-complete, but I can imagine neural nets being more and more widely used in both visual art and music. I agree there’s great potential in neural music! (I suggest some experiments in my conclusion but there’s tons more that could be tried).
The GAN’s goal is to match these photos, not to match 3D scenes (which it doesn’t know anything about).
I’ve see some results here where I thought the consensus interpretation was “angle as latent feature”, such that there was an implied 3D scene in the latent space. (Most of what I’m seeing now with a brief scan has to do with facial rotations and pose invariance.) Maybe I should put scene is scare quotes, because it’s generally not fully generic, as the sorts of faces and rooms you find in such a database are highly nonrandom / have a bunch of basic structure you can assume will be there.
Great examples. I agree the physical medium is really important in human art: see my Section 1.3.1.
I like the point about hands vs. “inverted eyes”. At the same time, the GANs are trained on a huge number of photos, and these photos exhibit a perfect projection of a 3D scene onto a finite-size 2D array. The GAN’s goal is to match these photos, not to match 3D scenes (which it doesn’t know anything about). Humans invented perspective before having photos to work with. (They did have mirrors and primitive projection techniques.)
I agree that our facility with stick figures probably depends partly on the history of using stick figures. However, I think our general visual recognition abilities make us very flexible. For example, people can quickly master new styles of abstract depiction that differ from the XKCD style (say in a comic or a set of artworks). DeepMind has a cool recent paper where they learn abstract styles of depiction with no human imitation or labeling.
Currently humans play a major role in the interesting examples of neural art. Getting more artist-like autonomy is probably AI-complete, but I can imagine neural nets being more and more widely used in both visual art and music. I agree there’s great potential in neural music! (I suggest some experiments in my conclusion but there’s tons more that could be tried).
I’ve see some results here where I thought the consensus interpretation was “angle as latent feature”, such that there was an implied 3D scene in the latent space. (Most of what I’m seeing now with a brief scan has to do with facial rotations and pose invariance.) Maybe I should put scene is scare quotes, because it’s generally not fully generic, as the sorts of faces and rooms you find in such a database are highly nonrandom / have a bunch of basic structure you can assume will be there.