Are you implying that it is close to GPT-4 level? If yes, it is clearly wrong. Especially in regards to code: everything (maybe except StarCoder which was released literally yesterday) is worse than GPT-3.5, and much worse than GPT-4.
I’ve tried StarCoder recently, though, and it’s pretty impressive. I haven’t yet tried to really stress-test it, but at the very least it can generate basic code with a parameter count way lower than Copilot’s.
Are you implying that it is close to GPT-4 level? If yes, it is clearly wrong. Especially in regards to code: everything (maybe except StarCoder which was released literally yesterday) is worse than GPT-3.5, and much worse than GPT-4.
I’ve tried StarCoder recently, though, and it’s pretty impressive. I haven’t yet tried to really stress-test it, but at the very least it can generate basic code with a parameter count way lower than Copilot’s.