People care if you are unshowered, drunk/high, schizophrenic/screaming, asking for money, going to steal, etc.
It just so happens that the two correlate a lot.
--
This doesn't negate the question of how to help these groups, but real solutions do require us to be honest with ourselves.