There are certain weights you place on each factor depending on the target of your site and what it is offering.
1) Visualizations where the goal is to help the user understand things that are too complicated to grok from raw data. Examples include histograms, line graphs, pie charts, etc.
2) Visualizations where the goal is to help the user actually create more complex thoughts than would otherwise be possible. Examples include mind maps, concept maps, flow charts, etc.
The goal of a visual interface, as opposed to a visualization, is to reduce the cognitive load required to use the software.
I think a lot of reason why we see such garbage is because many people are choosing a visualization from the wrong category to solve their given problem.