It seems reasonable that the majority culture should hold some sensitivity to minority elements. Christians would be upset to see a tabernacle used out of context. We should show the same respect to the morally equivalent symbols on other cultures. That idea seems compatible American values - no prohibition of speech, but mutual freedom and respect.
This idea has been rapidly and rabidly misinterpreted as absolute ownership of all unique elements of a culture by its members, and an imperative to shame anyone that uses any symbol they don't 'own'.
I don't know that I had a broader point besides that those crying cultural appropriation should take a deep breath, and those of us shaking our heads should recognize that the idea does have some value