I suffer from hyperventilation syndrome and anything that brings my attention to my breathing (including wearing a mask) sets it off. I feel suffocated wearing a mask. I can get out of breath, have tachycardia, dizziness, chest pain if I wear it for a long time. And yet I wear my mask everywhere I'm asked to.
There is a big difference between feeling suffocated in your own home where no one else is involved vs. among people you could potentially be putting at risk.