If I invited a dozen guests to a party at my house and half of them objected to having #7 on the guest list because he's a shitbag, it would not bother me one bit to have him disinvited.
If, on the other hand, I myself were disinvited in such a manner, my first thought would be to reassess my recent behavior rather than suing the house owner.