Reasons why cab drivers could not pick you up: 1.) shift change in 15 minutes. So they can take you 15 minutes away but they can't drive an hour into Brooklyn and miss their shift change. 2.) Car maintenance, refueling. If the car is running low on fuel they can pick people up on short drives towards the gas station but it wouldn't make sense for them to go the opposite way.
I am all for dialing 3-1-1 and think people should, however sometimes knowing the full context will take you from being upset at the cab driver to being understanding.