Ask GPT to hash you a word (let alone guess which word was the origin of a hash), it’ll just put together some hash-like string of tokens. It’s got the right length and the right character set (namely, it’s a hex number), but otherwise, it’s nonsense.
But GPT can do base64 encoding. So what is the difference?
What do you mean? Base64 encoding isn’t the same as hashing. Besides, I expect it would be very easy to make a “toolformer” with a hashing module, or even access to a Python interpreter it can use to execute code it writes, but that’s a different story. Perhaps you could even walk one step-by-step through the hashing algorithm I guess.
But GPT can do base64 encoding. So what is the difference?
Base64 encoding is a substitution cipher. Large language models seem to be good at learning substitutions.
What do you mean? Base64 encoding isn’t the same as hashing. Besides, I expect it would be very easy to make a “toolformer” with a hashing module, or even access to a Python interpreter it can use to execute code it writes, but that’s a different story. Perhaps you could even walk one step-by-step through the hashing algorithm I guess.