I guess the interesting question to me is: how often does this matter? How many successful mitm attacks on ssh connections are there and in what sort of circumstances do they occur?
It seems like it ought to matter, but if roughly nobody verifies and yet the sky has not fallen - does it?