It's not like police generally go about knocking down walls to find criminals either. Quite often, bypassing walls and locks requires a warrant. And I'm all for police being able to use a warrant to demand that you decrypt a message.

Demanding that people use no or easily breakable encryption amounts to demanding that people use easily pickable locks. Or walls with holes in them. It undermines the security of ordinary people.