This is a fascinating example of perhaps why a move towards a "world model" or some better form of representation can be helpful.