Doesn’t Claude’s training data include all the tutorials and step by step walkthroughs of this game ever published on the internet? How is it not using this information?
According to the creator the “Claude plays Pokemon”, the internal knowledge in Claude can often be more harmful than good for successfully navigating the game. In the system prompt, Claude is specifically told not to trust it’s instincts and to rely on the memories in its context. See (starting @ 20:28):
It does have a lot of the info, but it doesn’t always use it well. For example, it knows that Route 4 leads to Cerulean City, and so sometimes thinks there’s a way around Mt. Moon that sticks solely to Route 4.
Doesn’t Claude’s training data include all the tutorials and step by step walkthroughs of this game ever published on the internet? How is it not using this information?
According to the creator the “Claude plays Pokemon”, the internal knowledge in Claude can often be more harmful than good for successfully navigating the game. In the system prompt, Claude is specifically told not to trust it’s instincts and to rely on the memories in its context. See (starting @ 20:28):
It does have a lot of the info, but it doesn’t always use it well. For example, it knows that Route 4 leads to Cerulean City, and so sometimes thinks there’s a way around Mt. Moon that sticks solely to Route 4.