Not if the difference is trivial, but absolutely when it is as enormous and as unmotivated as it often is. Why would it be strange that obviously unfair inequality would be a source of animus?
"Of all the preposterous assumptions of humanity over humanity, nothing exceeds most of the criticisms made on the habits of the poor by the well-housed, well-warmed, and well-fed." — Herman Melville
EDIT: Phrasing.
The difference with wealth is that you can choose to become unwealthy on a moment's notice. So each day you remain wealthy is, itself, a choice. And the process of becoming unwealthy itself has direct benefits for the poor.
A white person cannot choose to become black and thereby remove oppression. A straight person who does not marry does not thereby yield the ability to marry to a gay couple. Even someone assigned male at birth who decides to present as female does not get to transfer her former male privilege to anyone in the process.
But someone who can afford a $10M condo that is as functional as (being generous) a $1M condo could directly transfer that $9M to people who don't have a place to live at all. So their choice not to do that—their choice to merely have money—is a decision we can justly evaluate morally, in a way we cannot evaluate merely having white skin or male presentation morally.
In my religious tradition, in our ritual confession of our faults, we apologize "for what I have done and for what I have failed to do." There is a story of a rich man who dutifully kept the ancient laws but refused to sell his possessions to the poor, and chose his possessions over the way of the religion. To remain rich (at least beyond one's needs and beyond the needs of one's credible plans to help the world) is an active choice, and can be criticized as any other choice.
It is right for oppressed groups to want to not be oppressed, it is not right for them to hate other groups because they are not oppressed.
"I hate you for having ∞x more than me and actively preventing me from having a decent life, just to milk a little bit more from me. I want my stuff"