Don't forget time dilation. If you move one end of the wormhole through space, both ends will be off in time too. It's more noticeable if you move it in relativistic speeds, but anything very fast should do the trick quite well.