Phone interviews bother me too. I am pretty sure I come through a little dimmer because I often ask the question to be repeated. It never occurred to me to prevent a potential misconception by letting the interviewer know that I have difficulty in hearing.