>if they don't take it out of the holster, there isn't even an issue here.
Somewhat true. But if you're not prepared to take it out of the holster, why even bring it? And the reason I say "somewhat true" is because somebody can take that gun out of a drunk's holster. I don't think that it's unreasonable to require that people be somewhat sober when holding a gun in public simply because it may diminish their capacity to _defend_ that gun.