I know that dice can be manipulated. I have read about a technique where dice can be put in the oven somewhere around 200 degrees with the intended values up to change the weight distribution and effect the probability without outwardly noticeable characteristics. Every time a player touches a die there is likely a possibility of them switching them with loaded replacements. Perhaps changing dice is a way to mitigate that risk.