Is your answer genuinely "I would let myself and those I care about suffer an unlimited amount of harm in order to avoid the possibility of inflicting an unfair prejudice on any individual"? Because according to your stated position, anything less is "defending racism".
And I strongly suspect that, if it were put to the test, you really would not accept arbitrary harm in order to "not defend racism". And if so, then you're publicly declaring that you hold a 'virtuous' position, when in reality you do not. And that is the definition of 'virtue signalling'.
Of course there's a practical limit to tolerance. This isn't it.
Said he, before proudly hanging his "No Irish" sign on the front door of his shop.
But this is a mild example that doesn't cost me much. I think it's an important thought experiment to figure out just how far you'd go and how much loss you'd accept to preserve that self-image of being "a good person."