That does not, however, seem to be a real justification for giving a check to a person a few towns away who does not own any property and who didn’t improve our neighborhood. What’s the justification in your model for giving him a cut?
There is an opportunity cost for society from every piece of land we cannot use for something new. That's reflected by the value of the land. If the value to the owner is much lower than the value to someone else, we aren't using the land efficiently.
It's also unearned income. It's ideal to tax unearned income because you don't create negative incentive for desired activities. It's in essence a tax that comes at no cost to society.
This also has the effect that being a landlord is disincentivized, and property prices have a downward pressure which allows more people to become home owners.
Homeowners already get crazy tax breaks that our society bears the cost of. This would just be an even bigger shift to funding government services on the backs of renters rather than homeowners, as any increase in taxes that "landlords" are assessed is passed on to renters.