If your acoustic environment is driving you nuts, you may want to speak to an audiologist and/or ENT. There is a condition called hyperacusis[1] worth asking about.
If everyday noise is debilitating or anxiety-inducing for and it doesn't seem like others are affected to the degree you are, it wouldn't hurt to speak to a hearing specialist. The causes and treatments of this (spectrum?) condition aren't entirely agreed upon, but tinnitus retraining therapy or other adaptation techniques might improve your life.