I’ve found it’s ability to be much better as well. In contrast to GPT-3, which often seemed to be unable to keep track of board state and made illegal moves toward the end of the game, it not only played legal moves, it actually mated me. Granted I’m a terrible player and I was deliberately not reading ahead to see if it would be able to mate a weak player. My method was to tell it I wanted to play and then give my move in algebraic notation. It would respond with a move, then I would respond with another. After it beat me, I asked it to list all the moves we had played. There were some minor errors in its notation (I think) which I’ve noted below.
Of course! Here’s a summary of our game in standard algebraic notation:
d4 Nf6
c3 d5
f3 c5
dxc5 e6
Bf4 Bxc5
Nd2 Nc6
e4 dxe4
fxe4 e5
Bg5 Be7
Bb5 O-O
Nf3 Qc7
O-O Bg4
Nc4 Rad8
Qe1 a6
Bxc6 bxc6
Rd1 Rxd1
Qxd1 Nxe4
Bxe7 Qxe7
Nfxe5 Qc5+
Rf2 Nxf2
Qxf1 Nd3+ (Here GPT-4 made a slight error, I played Qf1 but there was no capture)
Kh1 Nxe5
Nxe5 Qxe5
h4 Rd8
Qxa6 Rd1+
Qxf1 Rxf1+ (Here it checkmates me, though doesn’t mark the move as such)
I’ve found it’s ability to be much better as well. In contrast to GPT-3, which often seemed to be unable to keep track of board state and made illegal moves toward the end of the game, it not only played legal moves, it actually mated me. Granted I’m a terrible player and I was deliberately not reading ahead to see if it would be able to mate a weak player. My method was to tell it I wanted to play and then give my move in algebraic notation. It would respond with a move, then I would respond with another. After it beat me, I asked it to list all the moves we had played. There were some minor errors in its notation (I think) which I’ve noted below.
Of course! Here’s a summary of our game in standard algebraic notation:
d4 Nf6
c3 d5
f3 c5
dxc5 e6
Bf4 Bxc5
Nd2 Nc6
e4 dxe4
fxe4 e5
Bg5 Be7
Bb5 O-O
Nf3 Qc7
O-O Bg4
Nc4 Rad8
Qe1 a6
Bxc6 bxc6
Rd1 Rxd1
Qxd1 Nxe4
Bxe7 Qxe7
Nfxe5 Qc5+
Rf2 Nxf2
Qxf1 Nd3+ (Here GPT-4 made a slight error, I played Qf1 but there was no capture)
Kh1 Nxe5
Nxe5 Qxe5
h4 Rd8
Qxa6 Rd1+
Qxf1 Rxf1+ (Here it checkmates me, though doesn’t mark the move as such)