But that whole argument depends on the status quo in the US: many poor don't have ID cards already.
If you shift your view to the situation in other countries, it's easily answered: (almost) everyone has an ID card, so it cannot be used to disenfranchise minorities.
Issue ID cards to everyone and your problem should go away.