A good example of how incredibly incorrigible & mode-collapsed tuned model style can be is this 2023 poetry paper: even with 17 non-rhyming Walt Whitman poems in the prompt to few-shot it, ChatGPT still rhymed. (It’s gotten better, and now even passes my old “write a non-rhyming poem” test, but nevertheless, an alarming instance.)
A good example of how incredibly incorrigible & mode-collapsed tuned model style can be is this 2023 poetry paper: even with 17 non-rhyming Walt Whitman poems in the prompt to few-shot it, ChatGPT still rhymed. (It’s gotten better, and now even passes my old “write a non-rhyming poem” test, but nevertheless, an alarming instance.)