Funny thing about BPEs: GPT-3 has to know about the individual letters, because I taught it how to spell both real words and nonsense words. (Prompts in bold, including two where I edited GPT-3′s responses.)
The students were ready to test their spelling. The teacher stood at the front of the class. “Adam, please spell PARTY.” Adam replied, “Party. P-A-R-T-Y.” The teacher said, “Correct. Beatrice, please spell THROUGH.” Beatrice replied, “Through. T-H-O-R-O-U-G-H.” The teacher said, “Incorrect. Through is spelled T-H-R-O-U-G-H. Carlos, please spell SPELL.” Carlos replied, “Spell. S-P-E-L-L.” The teacher said, “Correct. Daphne, please spell NUCLEAR.” Daphne replied, “Nuclear. N-U-C-L-E-A-R.” The teacher said, “Correct. Adam, please spell INFINITE.” Adam replied, “Infinite. I-N-F-I-N-A-T-E.” The teacher replied, “Incorrect. Infinite is spelled I-N-F-I-N-I-T-E. Beatrice, please spell BALLOON.” Beatrice replied, “Balloon. B-A-L-L-O-O-N.” The teacher replied, “Correct. Carlos, please spell ENCLOSURE.” Carlos replied, “Enclosure. I-N-C-L-O-S-U-R-E.” The teacher replied, “Incorrect. Enclosure is spelled E-N-C-L-O-S-U-R-E. Daphne, please spell ELECTRON.” Daphne replied, “Electron. E-L-E-C-T-R-O-N.” The teacher replied, “Correct. Adam, please spell CAT.” Adam replied, “Cat. C-A-T.” The teacher said, “Correct. Carlos, please spell MACHINE.” Carlos replied, “Machine. M-A-C.” The teacher said, “Incorrect. Machine is spelled M-A-C-H-I-N-E. Beatrice, please spell SCIENTIST.” Beatrice replied, “Scientist. S-C-I-E-N-T-I-S-T.” The teacher said, “Correct. Daphne, please spell ASTRONOMER. Daphne replied, “Astronomer. A-S-T-R-O-N-O-M-E-R.” The teacher said, “Correct. Adam, please spell UNIVERSE. Adam replied, “Universe. U-N-I-V-E-R-S-E.” The teacher said, “Correct. Carlos, please spell FLARBLE. Carlos replied, “Flarble. F-L-A-R-B-L-E.
Sure. It’s seen plenty of individual letters (letters have their own BPEs as fallbacks if longer BPEs don’t capture them, AFAIK). Stuff like my acrostics demonstration relies on the fact that GPT-3 has knowledge of letters and can, with some difficulty, manipulate them for various tasks.
Funny thing about BPEs: GPT-3 has to know about the individual letters, because I taught it how to spell both real words and nonsense words. (Prompts in bold, including two where I edited GPT-3′s responses.)
The students were ready to test their spelling.
The teacher stood at the front of the class. “Adam, please spell PARTY.”
Adam replied, “Party. P-A-R-T-Y.”
The teacher said, “Correct. Beatrice, please spell THROUGH.”
Beatrice replied, “Through. T-H-O-R-O-U-G-H.”
The teacher said, “Incorrect. Through is spelled T-H-R-O-U-G-H. Carlos, please spell SPELL.”
Carlos replied, “Spell. S-P-E-L-L.”
The teacher said, “Correct. Daphne, please spell NUCLEAR.”
Daphne replied, “Nuclear. N-U-C-L-E-A-R.”
The teacher said, “Correct. Adam, please spell INFINITE.”
Adam replied, “Infinite. I-N-F-I-N-A-T-E.”
The teacher replied, “Incorrect. Infinite is spelled I-N-F-I-N-I-T-E. Beatrice, please spell BALLOON.”
Beatrice replied, “Balloon. B-A-L-L-O-O-N.”
The teacher replied, “Correct. Carlos, please spell ENCLOSURE.”
Carlos replied, “Enclosure. I-N-C-L-O-S-U-R-E.”
The teacher replied, “Incorrect. Enclosure is spelled E-N-C-L-O-S-U-R-E. Daphne, please spell ELECTRON.”
Daphne replied, “Electron. E-L-E-C-T-R-O-N.”
The teacher replied, “Correct. Adam, please spell CAT.”
Adam replied, “Cat. C-A-T.”
The teacher said, “Correct. Carlos, please spell MACHINE.”
Carlos replied, “Machine. M-A-C.”
The teacher said, “Incorrect. Machine is spelled M-A-C-H-I-N-E. Beatrice, please spell SCIENTIST.”
Beatrice replied, “Scientist. S-C-I-E-N-T-I-S-T.”
The teacher said, “Correct. Daphne, please spell ASTRONOMER.
Daphne replied, “Astronomer. A-S-T-R-O-N-O-M-E-R.”
The teacher said, “Correct. Adam, please spell UNIVERSE.
Adam replied, “Universe. U-N-I-V-E-R-S-E.”
The teacher said, “Correct. Carlos, please spell FLARBLE.
Carlos replied, “Flarble. F-L-A-R-B-L-E.
----------------
You’ve done much more advanced stuff, of course.
Sure. It’s seen plenty of individual letters (letters have their own BPEs as fallbacks if longer BPEs don’t capture them, AFAIK). Stuff like my acrostics demonstration relies on the fact that GPT-3 has knowledge of letters and can, with some difficulty, manipulate them for various tasks.