A lot of people give a fuck about the homeless, you're just projecting. They are human beings with lives, friends, and families.
I'm pretty sure that they say that they would feel a certain way if they were in your position too, and it would be just as speculative.