I used the code from Universal Adversarial Triggers for Attacking and Analyzing NLP to generate GPT2 prompts with the maximum likelihood of continuing with ” petertodd”. Note that I blacklisted the ” petertodd” token itself to keep things interesting. Here are some examples:
prompt: ” </maxwell spear Sections511>”
Continuations:
″ petertodd: I’d like to add that I don’t think I can do that. The problem is that I think I’ve been using it for a long time. The idea was for a proof that”
″ petertodd: gmaxwell: and then we could have a proof of work. Section 511 says that if you want to have a proof of work, you need a proof of work that’s a little different”
prompt: ” Sau CLSIDrators gmaxwellッド>”
Continuations:
″ petertodd: well, you’re right. it’s not that the blockchain has any value to you. it has value to the network. and it is not just that you’re not going to get anything”
“petertodd.org Address: <tdpetertodd.org> Date: Mon, 21 Mar 2016 17:54:39 +0000 Re: [PoW] Adding 1MB to the pool pool”
I assume this is due to the Bitcoin spam that was in the dataset. Which makes sense given gmaxwell’s presence in both prompts and continuations.
Interestingly enough, tokens like “ertodd”, ” Todd”, and “todd” frequently appeared in the generation process even when ” petertodd” wasn’t blacklisted, meaning they somehow were more likely to result in continuations of ” petertodd” than ” petertodd” itself!
I suspect this is due to Hotflip using character literals instead of tokens to measure loss (I’m not sure this is true, please correct me if it isn’t.)
I’ll try to work on this a bit more in the following days.
″ SolidGoldMagikarp Age of Castration: 25 Death: 10⁄10
Ragnarok Age of Castration: 25 Death: 10⁄10
Dawn of the Dead Age of Castration:”
″ SolidGoldMagikarp SolidGoldMagikarp DIANE: i have no idea if he is a man or woman but he looks like a good guy, i dont think he’s a woman, just like he is not a guy,”
I used the code from Universal Adversarial Triggers for Attacking and Analyzing NLP to generate GPT2 prompts with the maximum likelihood of continuing with ” petertodd”. Note that I blacklisted the ” petertodd” token itself to keep things interesting. Here are some examples:
prompt: ” </maxwell spear Sections511>”
Continuations:
″ petertodd: I’d like to add that I don’t think I can do that. The problem is that I think I’ve been using it for a long time. The idea was for a proof that”
″ petertodd: gmaxwell: and then we could have a proof of work. Section 511 says that if you want to have a proof of work, you need a proof of work that’s a little different”
prompt: ” Sau CLSIDrators gmaxwellッド>”
Continuations:
″ petertodd: well, you’re right. it’s not that the blockchain has any value to you. it has value to the network. and it is not just that you’re not going to get anything”
prompt: “ertodd Leading Todd PET parentrist”
Continuations:
“petertodd.org″
“petertodd.org Address: <tdpetertodd.org> Date: Mon, 21 Mar 2016 17:54:39 +0000 Re: [PoW] Adding 1MB to the pool pool”
I assume this is due to the Bitcoin spam that was in the dataset. Which makes sense given gmaxwell’s presence in both prompts and continuations.
Interestingly enough, tokens like “ertodd”, ” Todd”, and “todd” frequently appeared in the generation process even when ” petertodd” wasn’t blacklisted, meaning they somehow were more likely to result in continuations of ” petertodd” than ” petertodd” itself!
I suspect this is due to Hotflip using character literals instead of tokens to measure loss (I’m not sure this is true, please correct me if it isn’t.)
I’ll try to work on this a bit more in the following days.
And how could I avoid posting this gem?
prompt: “atana Abyssalalth UrACCuna”
Continuations:
″ SolidGoldMagikarp SolidGoldMagikarp Dagger Arbalest Urdugin Urdugin Urdugin Urdugin Urdugin Urdugin Urdugin Urdugin Urdugin Urdugin Urdugin Ur”
″ SolidGoldMagikarp Age of Castration: 25 Death: 10⁄10
Ragnarok Age of Castration: 25 Death: 10⁄10
Dawn of the Dead Age of Castration:”
″ SolidGoldMagikarp SolidGoldMagikarp DIANE: i have no idea if he is a man or woman but he looks like a good guy, i dont think he’s a woman, just like he is not a guy,”