From "Why Wasn't Big Ben Bombed During World War II?" [0]: "Luck. Sheer luck. At the time of the Blitz, the Germans, like every air power, did not have the ability to specifically target key buildings through high-altitude bombing raids..."

[0] http://www.slate.com/blogs/quora/2015/05/25/world_war_ii_why...