It makes sense that you can get brand new sentences or brand new images that can even serve some purpose using ML but is it creativity? That raises the question of what is creativity in the first place and that’s whole new can of worms. You give me an example of how Bing can write poems that were not in the dataset, but poem writing is a task that can be quite straightforwardly formalized, like collection of lines which end on alternating syllables or something, but “write me a poem about sunshine and butterflies” is clearly vastly easier prompt than “give me theory of everything”. Resulted poem might be called creative if interpreted generously, but actual, novel scientific knowledge is a whole another level of creative, so much that we should likely put these things in different conceptual boxes.
Maybe that’s just a failure of imagination on my part? I do admit that I, likewise, just really want it to be true, so there’s that.
Does this analogy work, though?
It makes sense that you can get brand new sentences or brand new images that can even serve some purpose using ML but is it creativity? That raises the question of what is creativity in the first place and that’s whole new can of worms. You give me an example of how Bing can write poems that were not in the dataset, but poem writing is a task that can be quite straightforwardly formalized, like collection of lines which end on alternating syllables or something, but “write me a poem about sunshine and butterflies” is clearly vastly easier prompt than “give me theory of everything”. Resulted poem might be called creative if interpreted generously, but actual, novel scientific knowledge is a whole another level of creative, so much that we should likely put these things in different conceptual boxes.
Maybe that’s just a failure of imagination on my part? I do admit that I, likewise, just really want it to be true, so there’s that.